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SYNOPSIS 


Poonacha P G Ph D 
Department of Elec rical Engineering 
Irdian Institute of Technology Kanpur 
October 1986 

FINITE DECONVOLUTION DATA RECOVERY SCHEMES FOR 
BLOCK DATA COMMUNICATION OVER DISPERSIVE CHANNELS 


In this thesis we study several data recovery (DR) schemes 
for block data transmission (BDT) over finite impulse response 
channels in the presence of noise In block data transmission 
due to Clark the input sequence is partitioned into blocks 
which are separated by guard zones of appropriate duration such 
that the channel output blocks do not overlap Since the 
channel is assumed to be linear its output can be represented 
as convolution of the input data values and the channel impulse 
response The operation of recovering data from the nonover- 
lapping blocks at the receiver is then essentiall/ that of 
finite deconvolution in the presonce of noise 

We formulate the deconvolution problem as minimization of 
a banded Toeplitz quadratic function with data as unknown varia- 
bles When the unknown variables are real minimization of the 
quadratic function is straightforward However when the varia- 
bles take values from a finite alphabet as in the case of data 
transmission it is dif-^icult to provide computationally attra- 
ctive solutions The solution to the deconvolution problem is 


optimal or suboptimal depending on the assumptions made on the 
unknown variables and the strategy adopted for solving the pro- 
blem 

We study maximum likelihood decision feedback and least 
squares deconvolution methods in detail Among those schemes 
maximum likelihood schemo is an optimal deconvolution scheme 
while decision feedback and least square deconvolution schemes 
are suboptimal Our mam concern throughout is to understand 
various theoretical and computational issues involved in 
developing DR scheme based on these methods 

Salient features of the DR schemes based on the above- 
mentioned deconvolution methods are briefly described in the 
following paragraphs 

1 Maximum Likelihood Doconvoluta on Scheme 

lie first derive a maximum likelihood (ML) recursive 
deconvolution algorithm (ML~RDA) based on Mitten s lemma which 
provides conditions for optimal decomposition of multistage 
decision processes This algorithm performs essentially the 
job of ML sequence estimation based on Vitorbi algorithm 
However the derivation of the algorithm does not require the 
use of state representation and explicit invocation of Bellman 
principle of optimality which are essential in deriving Viterbi 
algorithm The approach taken provides better insight into the 
ML deconvolution problem compared to the conventional VA appli- 
cation We hive shown that if the dat v lues are assumed to 


be real variables the recursive algorithm reduces to the 
familiar Gaussian eiimin tion algorithm for solving a set of 
linear equations We can therefore view ML deconvolution al- 
gorithm as a generalized Gaussian elimination algorithm for 
minimizing banded Toeplitz quadratic objective functions 

In the case of binary data v/o show that the ML RDA 
reduces to a special case of the algorithm given by Hammer 
et al for minimizing psoudo Bool an functions We further 
show that in the binary case the problem of reducing storage 
and computational complexity of ML RDA involves determination 
of minimal sum of products form of Boolean functions of 
several variables Therefore fast algorithm available for 
such purpose can be used to speed up computations and to 
reduce storage requirements Finally we show that the recur- 
sive algorithm derived for minimizing pseudo Boolean function^ 
Can also be used for ML-decoding of binary block cod-^s Use- 
fulness of tho method is illustrated with the help of examples 
However much remains to bo done in this direction 

2 Decision Feedback Deconvolution Schemes 

We next consider the possibility of incorporating decision 
feedback (DF) in DR schemes for BDT with the objective of 
achieving good performance without going in for f\L-deconvolu- 
tion which may not be economical in some practical situations 


DF-DR schemes consist of a forward filter for minimizing 
the effect of future symbols a nonlinear decision device and 
a backward filter for eliminating the effect of past symbols 
This scheme may be viewed as Gaussian elimination method of 
solving linear equations using forward elinination and backward 
substitution with a nonlinear decision device interposed bet 
ween forward elimination and back ubstitution tages 

For deriving DF~DR sch mes we first minimize the banded 
Toeplitz quadratic function assuming that tho data values are 
real This leads to the solution of banded Toeplitz system of 
linear equations We then derive throe DF-DR chemes for BDT 
The first scheme is based on Cholesky decomposition of positive 
definite matrices This scheme however does not take noise 
v nance into account The second DF-DR scheme takes noise 
variance into account and is based on minimum mean square error 
L criterion The third DF-DR scheme is based on minimum property 
of Fourier expansions over finite dimensional HilLert spaces 
This scheme is useful when the channel autocorrelation matrix 
IS illconditioned and when no knowledge of the noise variance 
IS available 

Finally we derive a DF-DR scheme by modifying Austin s 
detection theory approach We show that the modified Austin s 
method can also be viewed as Gaussian elimination method with a 
nonlinear decision device 



Least Squares Deconvolution Schemes-Direct App oach 

then undertake a ritical stuay o 1 ast uares (LS) 
deconvolution using discrete Fourier transforn (DFT) techniques 
The main f ature of our stuoy is in providing a general treat- 
m nt to the LS~decon /olution probl m using the notion of square 
completions of the channel onvolution ma rix V/e show that 
ooth LS solution and the con/ ntional DFT apoioach are particu- 
lar cases of square completions of the chann 1 convolution 
ftatrix Moreover DFT approach to the d convolution probl m is 
a particular case of k-Circclant completion of the channel con- 
voluiion matrix Based on k-Lirculant completions we develop 
two data recovery schemes which are easily implement able and 
ho^ve redu ed computational complexity 

Although DFT based deconvolution is widely used condi- 
tions under which such techniques provide optimal solution to 
d'=‘Convolution problem according to some criterion do not seem 
to have been explicitly m ntioned Me investigate condmons on 
k Circulant conoletions which provide Lo solution to the decon- 
volution problem Using the framework of quare completion of 
matrices we obtain conditions on square completion that pro- 
vide Moore-Penrose inverse of a full rank matrix Such cotrple 
tions are called orthogonal completions Then it is s nown that 
orthogonal k-Circulan romo3 tions are orthogonal k-Circulant 
na'^iices Using this resuJ t v;e show that for all practic 1 



ases of interest LS solution to the deconvolution problem can 
not be obtained via direct inversion of k Circui nt completions 

4 Least Squares Deconvolution Scheme - Iterative Approach 

Finally we con ider an ite atave d con /olution scheme 
using Steepest Descent Algorithm (SDA) One of the purposes of 
this study IS to examine tie obs'^rv tion of several authors 
working with fixed st^-p SDA in the DFT domain that the DFT 
domain iteration scheme converges faster thin the sample 
domain scheme For this purpose deriv SD^ in the DFT 
domain from three dif rent view points We show that the DFT 
domain scheme does not alter the conv rgence rate it only 
helps in reducing computational complexity at each iteration 
Ho\/ever it is shown that k-Circulant comole cions can be used 
to obtain good estimates of the convergence parameter in the 
case of some examples These es tinatod values can be used 
either in the sample domain or in the DFT domin to accelerate 
convergence 

Since the iror performance of each data recovery scheme 
strongly depends on the particular channel used we give an 
account of good channels for the ourpose of comoaring the per- 
formance of various DR sch mes Two criteria for good channels 
are considered The first criterion provide channels having 
maximum minimum distanc (f lu) called \ru O-channels These 
channels re used as benchmarks for comparing the performance 
of various DR scheme used on actual channels 



Determination of Mf^D^channels however is a difficult 
problem Therefore we consider the second class of good 
channels called maximum distance channels (i iD-channels) which 
maximize the total distance A procedure is given for obtaining 
MivlD-channels via MD-channel characterization For the purpose 
of comparing actual channels with N21D~char ncls we also de\elop 
a recursive algorithm for compu-iing the minimum distance of a 
given channel It is shown that some of the MliD and MD channels 
are partial response channels 

The performance of some of the data recovery schemes dis~ 
cussed earlier has been evaluated using computer simulation 
Performance curves showing the variation of probability of error 

With signal--to~noise ratio are given for a wide range of block 
lengths and typical channel examples 

The simulation stud> brings out the following merits of BDT 
over continuous serial data transmission (C nr) 

1) If decision feedback idea is used to improve the perfor- 
mance of BDT systems error propagation is limited to almost a 
block length in the worst case whereas in the case of DF“DR 
schemes for CSDT error propagation can extend over much longer 
duration Since in the rarge of n dium signal'-to-noise ratios 
the error propagation is a serious probl n with DF DR schemes 
for CoDT systems BDT with DF DR schemes are to b preferred in 
such applications 



2) f/ith an appropriate choice of the block length BDT can 
be used to provide better trade-off betw en perfornance proce- 
ssing complexitv and data rate 

A drawback of BDT is that the effecti/e data rate over the 
channel is less compared to CSDT for a given source rate The 
loss in data rate may be compensated by transmitting data over 
the channel at a higher rate This result in increased inter- 
synbol interference among the block samples Our simulation 
studies how vei indicate that if the block length is properly 
chosen the degradation in perfornance of DR schemes for BDT 
with increased intersymbol inteifcrence will not be significant 



chapter 1 


INTRODUCTION 


In this ho Ds we study several data recovery (DR) scheme 
for Dlocl data tra'^ lussion over linear time dispe^'sive channels 
in the pr scnce of noise In block data transmission (BDT) the 
input data sequence is pnmtioned into blocks which are separa 
ted oy guard zone o aporoonate duration such that the channel 
output blocks do not overlap ince the haniel is assumed to 
be linear its outputs can be represented as convolution of the 
input data values and th ch rnel impulse response The opera 
tion of recovering data from the nonoveriapoing blocks at the 
channel output is then essencially that o finite deconvolution 
in the presence of noise thai 2 given the channel impulse 
response nd the nonoverlapping hannei output blocks which 
have been corrupted by noise tho probi m is to recover the data 
at the receiver ond in some optimum manner 

Ve formulate the deconvolution proolem as minimization of 
a banded Toeplitz quadratic function /ith data as unknown varia 
bios When th unknown variables are r al minimization of the 
quadratic function is straightforward however when the varia" 
blcs take values fron a finite alphabet as in the case of data 
tr nsmission it is difficult to provide romputn lonally attra- 
ctivo solutions The olution to tho d con\olution problem is 
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optimal or suooptimal depending on the assumptions made on the 
unknovrti variables and the trategy oopted for solving the 
problem 

VJe study maximum likelihood a cision f eJback and least 
squares decon /olution methods n detail Ationg chese schemes 
maximum likelihood ( iL) scheme is an optimal deconvolution 
scheme wnile decision feedback (DF) and least squares (LS) 
deconvolution schemes a subop timal Our \na n concern through- 
out IS to understand va lous theoretical and computational 
a ssues involved in devi^loping DR scheTies based on those methods 

1 I MOTIVATION 

Design and evaluation of UR sch mcs for long strings of 
data transmitted over time Jispersiv chann Is in the presence 
of roise IS an mpoitan topic of study in the area of digital 
communication Development of v nous data transmission and 
recovery che ae which date back to the pion oring work of 
Nyqui t [l] and which continue to draw a great deal of atten- 
tion oven today has been primarily lotivated hy a de ire to 
increase the d la rate Thi is refl cted in the design of 
most of the available data transmission and recovery schemes 
In this connection continuous serial data txansrjssion (CSDT) 
happens to be the mo t vAdely used data tnnsni ssion scheme in 
;hich a continuous string of serial d a is brans Attod over 
the channel 
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In thr case of data tr nsnission over time disp rsive 
channels due to int r ymbol interfe ence (ISI) the signal 
sample at the receiver input b come highly correlated There- 
for irnole nenti tion of optimal Dr schonts for CSDT system 

o on s imoractical as the / require very larg obs rvation 
int rvals which m ans prohibitively larg delays nrd processing 
require icnts One method of circumv nting th se problems 
wh ch has 3 ceiv d considerable dttention is to nake d^'cisions 
based on truncated observation intervals This strategy 
reduces delay and processing time at the expense of increased 
orobabil t'j of crior The trade-off however apoears to be 
one sid d rom the point of viov^i of the following thioe major 
Jeman say good data transnission sy t m i expvctod to 
satisfy 

D1 Mini lum probability of error The piobabiLity of a 
de pct d da a symbol L ing in rror must be ninir/ium 

D2 Minirrum proc ssing tim Compu La b3 onal conolexity of 
the data recovery scheme nust be mini num no the sch me must be 
easily imple i ntablr 

D3 Maximun dat rate It must be oossible to transmit 
nata v lues on aft r another with minimum tane gap between 
ndj ac nt synbols 

The orego ng ciscussion highlights the lart th t there is 
s ill n v.a or in /es tigatmg alternate \/ays of oata transmission 
v^hich 1x11 holp in striking a bot cr compromise between D1 D2 
and D3 



An alternate method of r'=‘ducing delay and proc'^ sing 
r quirement vuthout sacriiyinc error peif or nance i to reduce 
he observ tion inter /al by aDpropriatel> ch ging the data 
tran miss on fornat Thi may be achieved by u ing BDT format 
studied bv Clark [2] - [4] tudy various da'* a recovery 

schenes for BDT vith tne following objectives in m rd 

1 \ better under tand ng of t}' e possible trade-off between 
performance processing comolexity and data transmission 
rate in the context of BDT 

2 A better appreciation of the merit anl dem iits of the 
existing DR schemes i or GSuT 

3 To criticall/ anal> e the advantages of BUT in situations 
where prooability o ciror performance ot the transmission 
system is more imporlant than achieving maximum data rate 
at the cost of error pcrfoimance as in the c e of CSDT 

1 2 REVIEW OF LITbRATURE 

To place our study in a proper perspective wc hall first 
review the exi ting literature on DR schemes for C^jDT and BDT 
Our int rest is not to give a detailed account of the histori 
cal ae/elopmont of v ra ous DR schemes Inste d wc wish to 
highlight some of the key developnont with the help of rol 
vant literature It may be pointed at the outset that most of 
the work is in connection with CSDT ref rences on BDT axe 
very few Wo review the literature on CSDT first and consider 
BDT later 


An alternaip> method of reducing delay and proc asing 
requirements without sacriiyinci error porf or nance i to reduce 
he observ tion inter /al by aoprop-riately ch ging the data 
tran miss on fornat Thi may be achieved by u ing BDT format 
studied bv Clark [2] ~ [4] }e tudy vinous data recovery 
scheries for SDT -^ith tne following objectives in m nd 

1 ^ b tter under tend ng of iJ e possible trade-offs between 
performance processing comolexit/ and data transmission 
rate in the context of 3Dr 

2 A better appreciation of the merit an 1 dem^^rits of the 
existing DR schem s lor GSuT 

3 To critically anal> e the advantages of 3JJT in situations 
where procability o error performance of the transmission 
system is more imporiant than achieving maximum data rate 
at the CO t of error performance as in the c se of CSDT 

1 2 REVIEW OF LITfcRATUPE 

To place our study in a proper perspective wc hall first 
review the exi ting literature on DR schemes for C*Dr and BDT 
Our int rest is not to give a detailed account of the histori 
cal de/elopment of v nous DR schemes Instc d we wish to 
highlight ome of the key developments with the help of role 
vant litei aturo It may be pointed at the outset that most of 
the work is in onnection with CSDT references on BDT are 
very lew Wo review the literature on CSDT first and considfP 
BDT la tor 



121 Data Recovery Schen s fo Continuous Serial Data 
Transmission 

The literature on DR schemes for CSDT in t e presence of 
ISI and noise is ri h wixh a wid variety of novel pproach s 
and related theoietical acvelopments A number of well written 
books are available on this topic i xts by Bennet and 
Davey [5] Lucl y 6alz and W Idon [6] and Proakis [v] provide 
excellent coverage of most of the important topics in the 
area of PoOT longwith long lists of references the text book 
by Clark [4] oroviaes wide coverage to both CSDT and BDT The 
collection of papers eaitcd by Franks [s] on data communication 
provides at a place tw nty four important works on CSDT along~- 
vath informative and well written long ditorial comments 
Important dev lopnents that took place 3n th'^ do i in of CSDT 
during 1968 73 are discussed with extensive bibliography in 
a survey article by Lucky [9] Most o the r oorr d data 
r covery schemes for CoDT are either some variant of one of th 
following thro schemes or their combinations 

1 Linear Data Recoveiy uchem s 

Th first and the mosr simple one is th linear DR scheme 
consi ting of a ma ch d filter mat hod to the channel folJowed 
by a trans/e sal filter whose output xs ampl d and used in 
making decisions First s st matic study in this connection 
app ars to b du to Tufts [lO] [ll] Extending th cla sical 
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work of Nyquist [l] Tufts [lO] has dan /ed an optimal linear 
receiver structure using iinimuT) mear square error (f SE) cn 
tenon As an extension of this work Smith [12] has obtained 
explicit solution to the optimum receiv r when the transmitted 
wavefom is subjected to an average power constraint The cri 
tenon o-^ optimization howe /er remains same as before 

Deviatinq considerably from the previous approaches and 
u ing detection theory point of view Austin [13] has shown 
that linear receiver can be derived on the assumption that the 
data values are indep ndenl GdUssian random variables The 
resulting trans^/ersal filter in general is of infinite length 
However for practical purposes only finit length filters are 
employed and the tap coefficients are optimized by minimizing 
the MSE between the filter output at the sampling instant and 
the actual data value Due to th«ir simplicity finite transv'^'r- 
sal filters have b en us d extensively for the p irpose of auto 
matic channel qu^lization [14J”[22] as well as for adaative 
equalization [23]"'[28] 

2 Decision Feedback Data R cover/ Scheir s 

The second DR scheme known as decision fe dback equalizer 
(DFt.) [13] [29] consists of a matched filter sampl r forward 

filtrr backward f Iter and a nonlinear decision device DFE 
makes use o-^ p t decisions to improv p rfoT lance Howev r as 
the actual decisDons are always orono to rror ( xcopt possibly 
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at high signal-to-noise ratio (Si^Ji)) DFc suffers from the 
problem of error propagation DFH structure can be derived on 
the assumption that the past symbols aie erroi iiee and that 
the future symbols are independent Gaussian random variables 
Usirg this assumption Austin [l3] has derived he structure of 
the DFE The resulting forward filter is in general of infi- 
nite length Hovever a in the case o linear UR schemes it 
is common practice to use only finite length and the tap 
CO fficients are optimiz d using ^iSE criterion DFC has since 
been studied from arious viewpoints [30]>-[37] 

3 Maximum Likelihood Data Recovery Scheme 

The third DR scheme kiovn as maximum likelihood DR scheme 
is due to Forney [38] He employed Viterbi algorithm (VA) [39]- 
[42] to alleviate th»^ co nputa tional complexity associated with 
ML sequence estimation ot data Th Ml sequence stimator 
minimi os the probability o^ soquenc eiror when all the 
s quences are qually likel/ Wo yyish to note here that an 
algorithm similar to VA has been dev loped by Kobayashi [433 
for ML decoding of a particular typo of PAIi signnl before the 
publication oi the Forn y s now classical work [3o] 

For ML s quence estima lor the requires ntiie obsorva 
tD on values For long da t s leams such a sch m therefore 
becomes un tractive bo h from the point of view of computa- 
tional corplcxity and storag-^ r quiromcnts To make the VA 
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useful decisions ar mad after a fi^ed numb r of observations 
uccom s av ilaol this nuno r is fixed empirically on th basis 
of channel nemory with the ssuinption that d gradation due o 
such premature decision is n jlsg ble [3^^] However since the 
perforn nee degradation strorgl d pends on the channel and 
noiso such an assumption n cds c reful coninjtion 

Aft r Forno/ s work all for s on ML DR schemes soom to 
have been dir c ced towards furth'^'r- reducing the connlexity of 
'Jk [ ^]“[52j Specific liy since the cornp itationai complexity 
of the Vft gro\/ xponen ti 13y witb the channel memo’"/ efforts 
hav been nad tu shorten lo channel impulse response duration 
by using prefiltcrs 

12 2 Data Recovery chern s for Block D i Transmission 

Clare [2] [4j has inves ig t d a number of adaptive dete- 
ction orocGs for BDT syst m In his work the BDi has been 

rtfe'^red to as iranSTiission o o thogonal group of signal 
elen nts by v rtuc of h f^ct that at the channel output such 
groups oo not overlap The rategy used V'y him is based on the 
recognition th t the dot ction of 1 me>nts in a group can be 
carried out solving a set or 1 near simultaneous equations 
using itoiati/G techniques In particular the adaptive dete- 
ction processe studied by him lal Q u e of the point Gauss- 
Seidel itecataon n thoQ I-e ha also censidered several modifi- 
cations of thi bas3c detection scheme to bake care of the 
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di Crete nature of tne oata From tho extensive siBUlation 
\A/orl carried out by him and his group [4J it app ars ti at such 
lodific tions lead to efficient and cc t eff'=*ctive DR schemes 
i;hose performance is comp raole to L approach Moreover such 
modifications do not require e cessivo number of sequential 
operation Extending thi approa h Clark and Ghani [53j have 
sxudied detection processe for multilevel signalling schemes 
Simulation resul-^s present d by them shovi that good toler nee 
o noise can be achievec oy such detection proc sses which do 
not require exces ive number of sequential opeiations 

Befoic \Ancin 9 up this section m wish to take note of 
th work o Klein anc /olf [54] in which BDT is consideied from 
a different point of vi They have investigated certaan as 

p cts of h possibility of des3oning a receiver niter such 
that the o/crall resoonse of the channel and the receiver fil- 
ter resembles a cyclic code generator However this line of 
thought docs not seem to have been pursuoo further 

1 3 KEY RESULTS AND OBo’^rV^TIOl 

As nontioned earli tho basic aporoach in our study s 
to view th di a recoveiy problc 1 as a finite leconvolution 
proolem in the pr sence oF noise alient featur s of the 
study are briefly descrioed in th fo31ov-/ing paragraphs 
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1 Maximum Lil'elihoocl Doconvolutxon Scheme 

tir t deiive a ML ri^cursive deronvolut on algof'i- 
thm (ML-RDA) based on Mitten s lenma [o5] wh ch pro /ides condi- 
t ons for optimal decomposition of multistage decision procG>^ses 
This algorithm performs essentially th job of ML equence 
e tination bas d on VA Hov/e/er the den /ation of the 
algorithm does not requir the use of state representation and 
explicit invocation of Bellman s principle o optimality [56] 
which are essential in deriving VA Th approach tak n provides 
b tter insight into th JlL deconvolution problem compared to the 
conventional VA aoplication We have shown that if data 
values a e assumed to be real variables the recursive algorithm 
r duces to the familiar baussian elimination algorithm for sol 
ving a set of linear equations We can th refore view ML- 
deconvolution algorithm as a gen rail zed Gaussian elimination 
algor thm for minimizing banded Toeplitz quadratic objective 
functions 

In th casG of binary data wr show that the ML-RDA reduces 
to a special cas^ of the algorithm given by Hammer et al [57] 
for minimizing pseudo Boolean fun tion We further show that 
in th binar/ case the problem of reducing Lorage and computa*~ 
onal complexity of WIL-RDA invol/cs detornination of minimal 
sum of products form of Boolean functions of seveial variables 
Therefore fast algo ithms / liable fo" such purpose can be 
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used to speed up computations and to reduce storage requirements 
Finallv we show that the recursive aigori hm deTived for mini- 
mizing pseudo Boolean functions can also b used for ML-decoaing 
of binary block codes Usefulness of the methoa is illustrated 
with the help of examples However much remains to be done in 
this direction 

2 Decision Feedbac< Deconvolution Schemes 

i/e ne'^t consider the oossihili y of incorporating dec sion 
feedbacl in DP schemes for BDT wi ti the objeciive of achieving 
good performance without going in for viL-deconvolution which 
may not be economical in some pricticai situation 

DF-DR schemes con ist of a foiAfard filter for minimizing 
the effect of future symbols a non3inear decision oevice and a 
backward filter for cli iinating the effect of past symbols 
This scheme may be v ewed as Gaussian elii ination method o± 
solving linear equations using forward elimination and backward 
substitution \ath a nonlin ar decision de/ice interposed bet- 
ween forward elimination and back substitution stages 

For deriving DF~DR chemes v;e f rst miniftizo the banded 
Toeplitz quadratic function assuming that the data values are 
real This leads to the solution of banded Toeplitz system of 
lino r equations '/e hen derive three Db-DR schemes for BDT 
The first scheme is b i ed on Cholesky decompo ition of positive 
definite matrices Tha s schem lioi/ever does not take noise 
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variancp into account The second DF DF scheme takes noise 
variance into account and i based on minimum mean square error 
criterion The bhird DF-D1 scheme is hasel on minimum property 
of Fourier expansions over finite dimensional iilbert spaces 
[58] This sneme is useful when the channel autocorrela ion 
iratrix is ilicondD tioned and vhon no kno d dge o-^ the noise 
variance is available 

Finally we derive a DF-DP schone b/ modifying Austin s 
d ection theory approach [lo] ie shovj that the modified 
Au tin s method can Iso be /leved as Gaussian ol minaiion 
method with a nonlinea deci ion device 

3 Least Squares Deconvolution Sch mes-Direct Aporoach 

'Ve then undertake a critical stud/ of least squares decon- 
volution using discrete Fourier transform (DFT) techniques The 
main feature of our study is in providing a general treatment 
to the LS-ooconvolution problem using the notion of square 
completions of the channel convolution m trix We how that 
both lS solution and the conventional DFT aporoach are particu- 
lar cases of squai completions of the ch nnel convolution 
matrix Mor'^ovor DFT approach to the deconvolution problem is 
a paT-ticular eas of k-Circulan completion o the channel con- 
volut on natri) Bas^d in k-Circulant completions we develop 
two data recov ry schemes which are easily impl mentable and 
have reduced computational conpJoxi-iy 
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Mthough DFT based deconvolution is widely used [b9]-* 

[o:)] conditions under /hich such ■'•echiiqups provide optimal 
solution to deconvolution problem accordinr to some criterion 
o not s ern to have been explicitly mentioned We investigate 
conoitions on k-Circulant completions wtich provide LS solution 
to he decon /olution problem Using th framework of squa^'e 
completion of i atrices we obtain conditions on scuare conple- 
ions that provide Moore-Penrose inveis of a full rank matrix 
Such completions are call d orthogonal omplr>tions Then it is 
shown that orthogonal I -Circular t coi letions r ortnogonal 
l-Circulant ma rices Usin this suit vj' show that for all 
practical cases of int rest Lu solu on to the deconvolution 
pioolem can not be ootained via oirect inversion of l-Circulant 
completion 

4 Least Squares Deconvolution Schene-I terative Approach 

Finally we con&i ler an iterative deconvolution scheme 
using steepest desc nt algorithm (SDA) One of the purposes 
of thi study IS to examine the ooseivation of sev ral authors 
[21] [22] [64] [66] working with fixed stop SDA in the DFT 
domain that the DFT domain iteration scheme converges faster 
than the sample domain ch me For this purpose we derive SDA 
in the DFT domain ff'om throe different viewpoints \J& show 
th t the DFT domain scheme does not alter th convergence rat 
it only helps in reduc ng computational comol xity at each 
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iteration Howevoi it i<; shorn that k-r'irculdnt completions 
can be usod to obtain good stimates of the conv^ rgen e para- 
meter in the case of some examples Th so ostinated values can 
be us d ither in the sample oomain or in th'= DFT domain to 
acc lerate convorgenc'^ 

Since the orror p rformanco of each jF schem trongly 
depones on xhe particular channel used we give an account of 
good channels for the ourpos of compa'cing the performance of 
V nous scheme Tvo criteria for jood channels are con- 
idered Th fust cri erion provide channel having maximum 
minimum oistancc (/LiD) c lied /1i iD channels Th so channels 
art u cd a be chna Is for conparmg the pt-rformance of 
various DR schemes used on ac al chann Is 

D termination of MivSD-chann Is however is a difficult 
proalom Therefor w consid r the second class of good 
channels called maximum oistanco channels ( iD chainei ) which 
rnaximi? the total aistance A procodurt is given foi obtain- 
ing i iD~channols via ^lD-channGl characterization For the pur- 
po of comparing actual channels with IMD-channols /'/g also 
a velop a lecirsiv algo ithn for computing th minimum dis- 
t ICC of a given chann 1 It is shown th L some o the AMD 
ai d \D channels art partial re ponse chann^^ls 

The pcrforianc of some of )c iata Ttcovery schomes dis- 
cussed arliG"' has been evaliatcc using cotnoj er simulation 
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Ferfomance curves shov;ing the variation of probability of 
rror v/ith s gnal-to-noise ratio are given for a wide range of 
block 1 ngths and typical channel examples 

The sjmulition study brinjs out the following merits of 
BDT o\ er CoUT 

1) If decision feedbacl ide is used to imorove the per- 
formance of 3ji systems erior o'^'opa^ation is limitea to almos 
n block length in the worst c se whereas in the case of DF-Di 
sene 1 9 for 2 DT error piouagation can ex end over much longer 
duration t>ince in the anqe o medium signal- to-noise ratios 
the error proo g tion is a serious proble fi with DF-DR schemes 
for r^DT svston uDT with JF DR schemes are to preferred in 
such applications 

2) With an appropriate choice of the block length BDT can 
b used to provide bet+er trade-off b tween performance proce 
ssing cornolexity and data rate 

A drawback of BDT is that the effect ve data rate over the 
channel is less compared to CSDT for a given source rate The 
loss in data rate may be compensated oy transmitting data ov i 
the channel ac a higher rare This results in incr a ed lol 
anono the block samples Our Simula ion studi s how ver indi~ 
catc hat h clock lungch i propc ly ciosen he degradation 
in perf or nance o DK schem for BDT v^/ith increased ISi will not 
be significant 
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1 4 OPGANIZATtOn OF THE TtESIS 

Be ides this chapter the thesis consists of 8 chapters 
Chapter 2 gives a detailed account of the assumption nade in 
the study chann 1 model coisid'^red a discussion of the BDT 
format anJ problem formulation In Chapter 3 we develop a re 
c irsive algorithm for max mum likelihood deconvolution of data 
and study the application of this methodolog/ for decoding ox 
error correcting binary block codes Decision f edback DR 
scheiies are studied in Chapter ^ Application of k-Circulant 
matrices for designing cost effectiv DR schemes is studied in 
Chapter 5 In Chapter 6 we discuss condi cions on k-~Ci culants 
for providing least squares solution to the data recovery pro 
blem Application of steepest descent algorithm for LS- 
deconvolution is dis ussed in Chapter 7 In Chapter 8 we 
study the performance of some ox the DR schemes developed in 
the thesis Chapter 9 gives conclusions and suggestions for 
further research 

/ 1 J NOT ATI Oils 4 D CONVENTIONS 

In this sec ion we v/ish to mention some of the notations 
ana conventions which aro common to ail the chapters of the 
thesis Pest of he noxations and conventions aie explained in 
a list included after the li t of figures Lower case letters 
with a biT below are used to denote sample domain or time do- 
main vec ors For exanple a h x are sample Jonain vectors 
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Upper case letters with a bar below r present DFT or frequency 
domain vectors of the corresponding samole or time domain 
V ctors Upier cas let! rs without a bar below except r and 
C rep esent matrices and O^^^n ^®sp8c ively denote iden- 

tity matrix of order m and null matrix of order mxn and 
denote rn-dimensional leal and complex vector spaces respectively 
Ue use R(*) to denote the range soa e of A - the space spanned 
by the columns of A and N(A) to denote the null space of A- 
the space of 11 v<='Ctors x such that *x = o Lower case letters 

without under bar are use to denote variable nd constants 

T 

Transpose of a matrix B is denoted as B If b is a complex 

matrix B denote comolex conjugate transpose- of B Similarly 
x- 

B d notes complex conjugate transpose of vector B 

jj X 11 derotos the Euclidean norm of the vector x given by 
II X i| = (/ 

I I A 1 I denotes norm of matrix A Wh^n A is symme- 
tric j I A I I = max I X j where jX j is the absolute value 

l<i<n 

of the 1 h eigenvalue of n n n matrix A 

Fnd o h proof of theorems is indicated by double 
star (**) Comoutational complexity of algorithm is denoted 
by O(gin)) which xs to b read as o^der of g(n) 
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CHAPTER 2 

BLOCK DATA TRANS VlISSION 

In this chapter wc et the stage for the development of 
Inter chapt'=‘rs The assumptions made in th stu \y are given 

in Section 2 1 Discrete model of the chann Is used in the 

stud/ IS discu sed in Section 2 2 Block data transmission 
form t and some of its detaiJ s are given in Section 2 3 
Finally in Section 2 4 ve how that the oeconvolution problem 
is equivalent to minim za lOn of positive d finite Toeplitz 
quadratic function \ath data as unknov^ns 

2 1 ASSUMPTIONS 

Consider the data xransmission system hown in Figure 2 1 
In the figure input data siream to the transmitter filter is a 
sequence of impulses{ x 6 ( t-iT„) Iwhere T„ is the intersymbol 
dur bion and 6(t) denotes an unit impulse function deno- 

tes the value of the ith transmitted symbol The transmission 
path IS a linear ba ©band chain'll consi rinq of a lodulator 
bandpass channel and a cl modulatoi tioi e is aeded at the out- 
put of the channel 

For the purpose of stud> we make follo\ang assumptions 
regarding the data transmission system 
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1 A synchronous data transmission syston is assumed That 
IS the receiver has knowledge of the correct ipling in tants 

2 The ba eband channel is linear and i is characteriz d 
b/ ar inpulse response h(t) In lost o th prac xcal cases 
channels can be modelled cither as time invariant or as lovifly 

imc varying In the case of tin varying channel aata 
recov ry sch mos must be made adapxive V ho evoi will not 
s udy this aspect in this the s 

3 The chann-^l impels rosoinse is of fir e duration This 
assunotion is met b/ mo t o the practic 1 ch nnols A1 hough 
for a bandlimited channel the impulse response is of infinite 
duration in mo t of the case ipulse response becomes n gli“ 

c blc after a finite duration 

4 Data symbols aro statistically independent and take on 

valu with equal probability from the sot 1+1 +3 +5 +(q~l)} 

where q is an even integer This assumption is rarely met by 
any practical com unication syston However it can be r alizod 
t som^ extent vath the help of scramblers at the tran mtter 
end The effect of scrambling can be removed by descrambling 
the data symbols at the receiver end (see Clark [4] page 178) 

5 Iloise samples are statistically independent and each 
sample is a Gaussian random vaaiabl with zero mean and /anance 
h^/ Th white Gaussian noiso assumption is widely u^ed as it 
consioerably simplifies maGhematxcal analysis and provides worst 
Case ocrformance 
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It ma/ bo noted the c although some of those assumptions 
nay not b valid xn pr^c ic th / provide a Js ful f amciAork 
or formulating and analysing the problem 

2 2 DISCPETE TIViE MODEL FOP ISI CHAlMNELS 

Due to the pr sence of th sampler aft r the receiving 
filter (see Figure 2 1) it is conv men! to anal/se tho base 
band data transmission s /stem vi/ith a discrete time equivalent 
node! When a finit number of da a ymbols arc transmitted 
over finite ISI channels ii he presence o vjhit G ussian 
noise it can be shown '^30] [7] that he channel lod 1 shown 
in Figure ? 2 provides an quivalent model for the estimation 
of th input sequence withou any loss o rror performance 
For this to happen transfer function of tho transversal filter 
I (z) must be chosen such that 

X( z) = H( z) ( z) 1) 

whore X(z) is the z-transfon of the autocorrelation function 
of rho channel impulse response h(t) and H(z) is a oolynomial 
hiving roots of X(z) which are in ide the unit circle 

Clark [3] has consider a chdi rcl responses doriv d in a 
d ffereni manner H as lmg that effective, multipach distor 
tion intro Juced by the transmission path can be modelled as an 
quival nt sampled impulse respense of uho linear tiansmission 
oath The ov rail simplcd r spons of th channel is obtained 
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by considering identacal trinsfnr functions fox bo h trans utter 
and receiver filters 

Fo-" the puiposG of study we use th“ discrete time model for 
finite ISI channels sho ;n in Figure 2 The lodel consists of 
a finit length transver 1 jlt r \/ho e tap coefficients 
reflect the ffec o transmitter filter cha inel and receivincf 
falter Flexibility in the choi e of the tao cocf f icif=>nts to 
tate care of a w d class of channels incluoing channel varia- 
tions (by macing the lap coefficaents vary v/ith tine) nd the 
inple inamer in vi/hich it captures the es en lai idea of ISI 
and noise are iho major onsidevations for l ing t e model in 
the s udy 

In Figure 2 2 denotes a s quence of statistically 

independent data s/n ols denotes a sequence of independent 

Gau sian random variaoles vath mean zero and variance 

1 = 0 1 g are the ch nnel paran t s j inoicates 

the number of ISI components and it depends upon h aata 
rate and duration o the channel iroul o response As the data 
rate increases g also increases 

Fion the chann 1 mod 1 f Fiqur 22 it is easy to see 
tnat ch outDut scqucnc has the follov/ing r presentation 

r = 2 h, X . w 1=012 (22) 

1 1{=0 ^ ^ 1 
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Data rocov r/ oroblem in h case of CSDT systems is 
essentially thax of solving the ot of Gqeation giv n by 
(2 2) for s In tie ca e of long strinjs of data this 

becomos a di ficult problem due to the large numoor of equa- 
tions which are to be solved n h pr sence of noise Block 
data transnission xormat v/hict o/crcomes this problo i is des- 
cribed in tho following ection 

2 3 BLOCK DAT/ TBWo ISSION FORMAT 

In 3DT blocl s of data of 1 ngth m va h each block 

followed by g z ros is transmiiied through the ch nnol If 

the source data rate s l/fg symbols p r socord due to tho g 
zero follovanq each block th ffecti/o rate of transnis ion 
1 11 be m/(nT ) syibols per second where n = m+g On the 
other hand no reduction in data rate is xporionccd 3f he data 
symbols are transmitted through th channel at a rate of 

symbols per second v\;here T^ is obtained a ^ « L t g 

b chosen such that the cnannel dispe sion duration (T^) coos 
not G cced (g +1) i seconds That is 

(g +1)T^ > (2 3) 

Then T^ i giv r by 

= n lg/(m+g j (2 4; 

uos 1 tut mg tho v luu of T from (2d) n (2 3) wo obtain 


g > m (VT3)/(mT3-T^) , raT3 > T,^ 


(2 5) 
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Due to the pr^-s^nce of g z ros following each transmitted 
bloc! the channel is forced into zero state before the arrival 
of a fresh block at the input hus the effect of the channF“l 
IS confined to blocks of lenj h n v/hexe n = m-^g Therefore 
ISI does not propaga o from one block to the ubsequent ones 
Due to this f atUT'e blocl s can be processed ind pend ntl/ at 
the receiver to recover data /alue Note that tMO buffers 
will be needed of which one wiJl o® receiving the next block 
hile the other holds th curient block for oroce sing 

Figure 2 3 helps to nake some of the ic s expressed in 
the previou paraaiaphs more clear In Figu 2 3a a rather 
simplistic channel is shovn for the purpose of illustration 
Th Qita duration is assumed to be one third of tne duration 
of the impulse, respons Oucout of the channel shown in 
Figure ? 3a to ai arbitrarily chosen s+ring of binary (il) 

Jdta IS shown in Figure 2 3b Figure 2 3c shows the corres- 
ponding o/erlap^ing pulse responses Figures 2 3d and 2 3e 
show tho corresponding situation in the case oi DDT with 
increased da a rat over the channel In this case m = 6 
q = and n = 10 Moreo/er w obtain T. ~ 0 6 T^ as the 

data transmission rate ov r the channel From tho Fijuros 
/ d and 2 3e it c n be seen tha the blocl s get separatee at 
th channel outpu-1 

Cer am features of the inequality (2 5) can be made 
clear with a graphical repr entat on For this purpose 
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let p = Then (2 j) becomes 

g > (p-l) m/(m“p) m > p (2 6) 

In Figure 2 4 g i plo ted against m xor variojs valuv^s of p 
v;h n g is given by 

g = (p 1) m/(m“p'' m > p 

N tc that althouoh n an g a’^c in teg rs in Figure 2 4 

in order to avoid oo many ^mbols g is plotted as a continuou 

function of m for m > p From the figur it s clear tiat for a 

g3 ven p m must be sufficiently large for g to be small Under 

this condition will b close to /e al o observe that 

o s 

the requiic value of g lev Is off fast after dropping rapidly 
n th beginning This m ans that tho effect of ISI among the 
memb rs of a block will not become too large if moderate value 
of n is chosen 

2 4 THE DECO IVOLUTION PPOLLLM 

In this section we formulate the d convolution problem 
L t h be an n~l ngth vector vuth first g elements as the 
channel par mot rs and res of bn olcnet ts zero Let x denote 
an in-lcngtl oata vector and ran length obs rvatDon vector In 
terms of th se v^ectors h convolution relationship given by 
(2 2) can be /ritten as 


r H X + 


(2 7) 
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FIG 2 4 


Plot of d' v«''sus m 
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v/h P 1 th con /olu ion ma t i Jith h as ti -Fir t column 
For th sa/c o illustration H rnati: as ho\m b low 


ri = 


0 


0 

h. 


0 


0 

0 

h 


h 


0 0 


0 


o 


n 


g 


he (i j)th el n nt oj: H is given by 


h. _ = 
ij 


0 for i>3 an I i-j > g 


1 “ 1 2 3 


n 


1=12 3 


m 


The oroblom of d i irnining x given r and h ox finding h 
qiv n r and x as call d finite d convolution orobl m in tho 
pi sence of noise 
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1 o Droble~i has received as much attention as tho finite 
ieconvolution problem due o its ppearance in a wide /ariety 
of applications [59]-[61] [67]-[71] However most o the 
methods available for dealing with the problem a ume that the 
uni nown ya'^iables are reaJ Vilhereas in the context of BDT 

th dat vector x cake di cr te values fron a inite alpiabet 
Therefore in this case / have to deal v; bh a coirbinatorial 
ae onvolution problem in which the pace oi all possible solu- 
tions do not po sess the nice proo riies of r'^ to \jhich real 
vectors oelong One straightforward method of deconvolution 
IS t search through all possible solution However even in 
the binary case searching through all possible 2’^ vectors 
becomes out of hand for modeTate values of m ivioreover due to 
the pr s nc^ of noise no xact solution is possible in general 
The usual aop oach tak n under such situations is to chooso a 
vector X which optimize sone suitable performance criterion 
Depending on the constraints put on the solution space one 
obtains different s lutions to the deconvolution problem in 
the presence of noise 

In d ta CO inuni cations the nos souglt after criterion is 
the ninimixdtion of tl rroi probability For he case of 
qually lik ly data vector it can be shown that the aaximum 
likelihood (tlL) segue ice osfcimation provides mini jum probability 
of rror [7] fho ML ostiaate of x i that vector which ma/i- 
mi es thr conditional density d(i/x) 
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iJTidl r the assunptions mad in section ? 1 th corditional 
dtns ty function of r niven a part_cular data vector x can be 
hovm to be 


o(r/x) 


^ exp( 

1=1 



g 

1 =0 


h|^X 


i*"k 



it IS Gas/ to see hat the abov density fine lion is maximized 
by minimizing th qjadratic fund ion 


F(x) = (r Hx) 


m 

= Z 
1-1 


n 


2 

3=1 


X X a 
1 3 


U 3( 


m 

1=1 




m 


h 

1-1 


(2 8 ) 


T 

where ai i is ch<- (i j)th elon nt of h^H and b is the ith 
ji-j j 1 

element of tie vector 2H^r 

■^hereforo the decon /olution problem in our case is equiva- 
lent to mininization of th quadiatic function given by (2 8) 
subj ct to the condi ion that tho unknown variables take 

values from a finite alphab t oince H is a convolution matrix 

T 

it IS easy to s e tl at H H i a symm trie Toeplitz matrix \Je 

v;ish to note that a squaie matrix D is called Toeplitz if 

~ U*"3 I ^^ij j)th olonent In addition as 

T 

g is less thc.n n H H is also a band J i atrix Thus the decon- 
volution problem is e sentiaily that of minimizing a banded 
ToGplitz quadratic unction subjee to different constraints on 
the unknown variables depending on various performance criteria 
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CHAPTCR 3 

MAXIiAUM LIKt^IHOCD D COlMVOLUTIuJ 


In this chapter we use Aitten s lemma [55] to derive a 
maximum likelihood recursive deconvolution algorithm (ML-RDA) 
v^/hich essentially performs the job of Viterbi algorithm (VA) 
[38] Ml ten s lemmi may be viewed as a more iorrnal statement 
of Bellnan s princiol of optimality [56] and it clearly stipu- 
lates the conditions for optimal decomoosi tion of multistage 
op 3 mi zati on problems For the sake of easy reference Mitten s 
leifuia IS given in Appendix A 

The chapter is organized in th oliowiny manner In 
Section 3 1 we use 4it en lemna to develop a general recur- 
sive algorithm for minimizing decomposable nonlinear function 
of several variables A specific case when tro nonlinear fun 
ction IS a quadr tic function s taken up in Section 311 It 
1 shown that minimization of a quaoratic function of real 
V enables using the r cursive algorithm is equivalent to 
Gaussian elimination algo'^ithm for solvina a set of linear 
simultaneous quations The discret version of the algorithm 
1 discussed in ooction 3 J 2 The ML-RDA for a banded 
Tooplitz quadratic unction (BTQT) is given in Section 3 2 
For the puTooso of comp i on in See on 3 3 wo discjss VA 
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for minimizing BTQF Strategies for alleviating storage and 
comoutational roquiroments are discussed in Section 3 4 Appli 
cation of th se strategies to Binary caso is considerod in de- 
tail in Section 3-^1 Application of the recursive algorithm 
for decoding of block error correcting code is considered in 
Section 3 5 

3 1 RCCURSIVh ALGORim\A TOi I UNI II ZAT ION OF NONLINEAR FUNCTION 

OF SEVERAL V PIA3LES 

In order to illustrate th principl of iv^L RDA we first 
give a method for minimizing a nonlinear function of n varia- 
bles Let ^2 x^) be a function to be minimized We 

assum that th function is dcconoosable in the manner indica- 
ted below 


F^(><) = F(x^ Xg 
( ^2 ^3 


x„) = U^(Xj X2 


n 


='r,) 


x„) + 


(3 1 ) 


Note that is func ion of x^^ alone Now 

suppose that inst ad of mininizing F(x) with respect to x 

ve can minimize Uj^ with respect to first and then mininii,ze 

the combined function min x^ ^3 

^1 

with r spoct to X 2 x^ Put differently we wish to 

conputo P 2 where 


P 


2 



[\^ l (^2 ^3 
^n 


Xj^) + min Uj^Cxj^ X2 

O 2) 



At this stage a valid question to ask is whether or not 

= min ^2 answer is y s then 

1 n 

eff ctively we have decomposed the n variable minimization 
problem into a single variable minimization pioblem followed by 
an n-1 variable minimization problem Thus it is essential to 
know whether we can distrioute inn operator as indicated in 
(3 2) vatlout affecting the op mum solution 

In Lemma 3 1 we show that whenever F, {x, x^) is 

i 1 n 

decomposable in tht manner giv®n by (3 1) 


P 


2 


min 

^1 


X 


Fi(x^ 


X, 


n 



vhich efrectively proves that the min operator can be distribu- 
ted in the manner shown in (3 2) We v<fish to note that 
Lemma o 1 is a sp cial case of the more general decomposition 
result giv n b/ Nitt n [55] for multivariable optirniz tion 
problems A proo-^ o Mitt ns result tor two variables may be 
found in [56] 

Lcmna 3 1 Given (3 1) and ( 2) = min ^2 

^1 

Pjoo-f^ Let P, = min ^9 

x, X ^ 

1 n 


From the definition of i nirium value we have 
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Uhonev t ^ ^2 

X2 >^3 fi>< cJ i folloAfs from (3 1) (sine 

Vj^(/2 ^3 3.S fired) that 

But fo each value of X2 x^^ 

U^(x^ Xj x„) = mn U)^(x^ x, x^) < U^(X;^ 

^1 

whe x^ IS th valu of at whi-'h ^2 

attains minimum value \;non X2 X3 x^^ are fixed 

Ther for^ from («-> 4) w c t 


^l^^l ^2 ^n^ - "^2 




for all x^ wi h /2 x^ 
IS fixed ) 


x^ fixed (since Vq^(x 2 x^ 


"n) 


Hence 


Fj^Cxj Xp X3 


Xj^) < min tjL^'^l ^^2 




H nc Po = 'Tiin 

x„ X 

2 n 


[«/j^(X2 Xg 


\> ^ '■'i<>'l ’'2 


= min ^2 


Xn) 


n 


min min 1 1 ( ^2 

Xp, X X. ^ 

2 n 1 


X ) = P, 

n'^ 1 


therofor 


P2 < Pi 
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From ( 3) we thus get = Pi 

Let be th^ value of Xj^ ;hich iiinimzes 
a fixed Xg x^ No that Xj^ b comes a function of 

^2 x^ x^ Let 

Xl = g^c X2 Xj x„) 

Substituting for in Fj^( ^ X2 Xj^) the minimiza- 

tion probl m now reduces to a n -1 v riable minimization problem 


min 

^2 ^n 


X3 x^) vhere F2(x2 Xg 


Fl(Xj X2 


>'n> 


Assuming again that F2 is decomposable we can write r2 as 


^2^ ^2 ^3 


y„, = Ujixj X, 


x,,) - V2(X3 X4 


>'n> 


Using Lemma o 1 we can write 


min ^3 


'‘n> 


= min [V2(x2 x^ 




n 


n 


min 1^2^ ^2 '^3 
^2 




Let X2 be the value of X2 which minimizes U2(x2 x^ x^^) Then 


X, = g (x _ X, 


>'n) 


The r cursive proc dure no v can b easily written for the ith 
stage as 
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=<0) = =<2 


* 

='1-1 "x 


Xr,) 


min F = min 

^1 ^n ^1+1 




\ } 


X ) + mn U (x 

n' y 1 ^ 1 

1 


X )] 


1 = 12 


n 


At the nth stage we obtain 

min Fj^(>^)=nin Uj^(x„) 

X X 

n n 

Th refore is a constant 1 e is a constant function 

oubstituting x^ in %-l^^n~l^ ^n-l obtained Continuing 

this procedure of back subs titu cion all the i = 1 2 n 

die obtained 

It is nob dif icult to see that the foregoing approach is 
v ry similar in spirit to the Gaussian elonination method of 
soJvinq linear inultaneojs equations which involves forward 
lamination and back substitution The collection of functions 

^1 “ "^3 ^ 4 ^ 

^2 “ 92^^3 ^4 ^n^ 


X 


A 

1 


= \+l \+2 



= g^ cons'cant 
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IS remriscent of th upper triangular m tri v;hich results 
after forward elirnxnation In viev/ of bhe foregoing observa- 
tion we wish to call the recursiv algorithm oev loped above a 
g neralized Taussiar elimination orocedure 

In the preceeding algo ithm ve implicitly assumed that the 

indic ted single variable minimization is Iways possible That 

IS mn U (x x^) o ist for all i and f xed x, , 

y 11 n 1+1 n 

1 = 1^2 n ho e /er this may not alway h oossible for 

an arbitrarily specifi d nonlinea tur tion in acdition sin- 
gle variable iiiimi ation itself may be difficult to carry out 
I\ v rtheless this approacn has several advantages in the case 
of the ML-dc convolution problem ormulatcd in Sec 2 4 Before 
discjssing that case we wisn to cons d r the pxobl m of mini- 
mizing a quadratic func ion of n rea variables as an illustra- 
lon of the orogoing recursive algorithm 

311 Real Variable Case 


For the sake of simplicity we consiocr n = 3 
tion to n variables is straightforward Let 


Generaliza- 


F, (x 


1 ^2 


X3) = -2 


3 

1=1 


3 3 


3 

i=l 3=1 


1=1 


®i3 ” ®3i for all 1 3 

where b a and r 1 = 1 2 3 are constrants Carrying out 
111 

the decomposition of with respect to w obtain 
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Fi = U^(Xj^ X2 X 3 ) + V^(X2 X 3 ) 

where LTj^Cxj^ ^2 ^ 3 ^ ~ ^ ^ ^1 ^11 

Xj^ wbi h minimizes m h x^ X 3 fi/ed is given by 


Xi - (b^ - 


we 


assume that aj_j_ ^ 0 Substituting in Fj^ we obtain 


2 ? . / v 2 


FpCx. Xo) = -2 S + 2 E X X a + 2 r:; + (r,) 

^ 1=2 ^ ^ -,=0 1 J 3 ,-^ r . 1 J - 


1=2 j =2 


1=2 


wh re b^ = ^i~^l ^li/^ll x = 2 3 
= I ' l - t ' i / sj ,! 


^ij " 1 J = 5 3 

low ^3^ " ^2^ ^2 ^3^ ^ 

v;h re UgCx^ X3) = -2X20^ + 2x^X3323 + ^2®22 
therefore X2 = ^ ’^ 2 “^ 3 ® 23 ^/^ 2 -=- ®22 ^ ^ 

u ing X2 we obtain F3(x3) == -2x3b3 + X3a33 + ^ 


ninimization of F3 gives 

X3 = b3 / d33 $ 3 ^ i 0 

Back ubstitut3on of 3 givos X2 n ch in u n gives x^^ 


CM CO 



The foregoing example clearly shows xhat the recur ive 
algorithm for minimization of a quadratic function or n varia-- 
bles IS equivalent to Gaussian elimination technique fox solving 
a set of linear equations 

312 Discrete Variable Ca e 

Haviig di cu ed certain aspects of the multivariable 
minimization with real variables v/o nov/ conside the case when 
he /ar ables take values f con a mite et Without any loss 
ot generality we consider tne quaoratic func ion used in the 
p evious section with the d fcrenc that th variaules take 
valjes from the set S = {-3 -2-10123) Cxtcnsior to n- 
variable case and any given firite alph u t is straightforward 

Following the steps as in the real variable cas in the 

first stage we have to -f^ind min Uj^(xj^ x^) In this case 

^1 

differentiation i not possible Hence wc must tabulate 

values of Xj^ which mininize for fixed and Xg The 

tabulation format is shown in Table 31 No of en ries in th 

2 2 

first column of th'=» table will be 7 corresponding to 7 possi- 
ble values of X 2 and x^ Moreover for each set of X 2 and x^ 

k 

; lu t ch ck 7 V lu 9 of o decide Thus th first stage 

3 

its<^lf in/ol/ s 7 Qvalu tions of Fu-rth r in genoral it 

«• 

IS not possible to expr'^s ^ closed form as in the caso of 

1 1 variables Therefore Xj_ can not b'^ uostituted in Fj^ to 

(• 

00 am r 2 This implic^ that \ie must use h t ble for in 
th second stage In th® socona stage we write as 
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Tnbl 3 1 Stege 1 Tabl 3 Stage 2 



j ^3 ~ ~ “3 

3 “2 - - “2 


3 ~1 


-1 


0 


3 


1 

2 

3 


For each value of ^2 and v/ can use fron the table 
for Thu in tnc so ond stag*^ wo minim ze U^+U 2 (x 2 Xg) with 

r spcct to X 2 by fixing Th re aio 7 different values for 

rd pQ-r oach x^ X 2 is to bo decided on the basis of 7 possi- 
ble valu s of X 2 Thu the second title will '^ive 7 ntries as 
shown in Taol 3 2 In a siitJar fashion wo can carry out tho 
computition required ir stage 3 with the help of Table 3 2 of 
stage 2 

Lot us no V xamino tho comoutational conploxity for n- 
variable as'- w th ach vinablo taking q discrete values In 
the first tage ev luitions of is required Likovifise in 
the ixh stage evaluation of is required On tho 

oth r hand a dir ct search method v/ould require q*^ evaluation of 
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th funct on F It thus becomes clear that for the scheme des- 
cribed to become conputa lonally efficient the unction al terms 
of U2 must be much inpler than the functional form 

of F In otherword U2 must have the following 

desirable properties 

1 ® nust be functions of a lail number or /ariables 
compared to the total number of variables involv d in the 
minimization problem 

2 Uj_ s must be easily computabl By this wo nean the number 
of addition and multiplications needea for evaluating the 
function nust bo snail 

/i/hen bo+h the properiie are sat sfied by an objective fun- 
c ion it 1 possible to reduce the number 01 computations and 
storage requirements substantially using the foregoing recur- 
sive algorithm compared to the direct enumeration approach It 
may how ver be noted that storage requirement is still large 
compared to the enumeration approach 

The obj ctive function in the cas of ML-deconvolution 
probl m formulat d in Section 2 4 is a special type of quadra- 
tic funcrion called banded Toeplixz quadratic function Such 
a quad itic function me ts th above mentioned requirements In 
the next sociion we derive a JiL-RDa or this case 
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3 2 RECURSIVE ALGOiilTHi FOR BAiMDhD lOFPLIiZ QUAD ATIo FUNCTIUNS 
recall from Section 2 4 that the function 


m 


m m 


F(x^ Xj x^) = 2 T' 

where | = 0 U~3 1 > ^ g < m 

IS called bciriueJ To olitz qu oratic unctioa (3TQF) for the 
matrix formed by a | eJements is a band d Toeplit 
matr x 


I et F^(x) = r(x) r the sake of uniform ty 
decomposed as 

n = -2=<ibi + 2Xi x^a |^_^| + xfa^ 

m mm 

+ [-2 ^ b, + 2 S X X ai I ] 


can be 


i~ 


+ L i, X x^ai I 
1 1 13 |i-j j 


- tj^(x^ X 2 Xg^j^) + Vi{^2 H 

Iiote tha Ui^ is only a function of g+1 variables Further 
IS a function of consecutive g+1 var ables rather than g+1 
arbitrar variables as it may happen in the case of a general 
obj ctive function This is a specia property of BTQF In 
addition the form of U at every stage is sai e Thus the same 
type of comoutation proceoure is used in evei> stage Through 
the folJoving example we have tried to illastrat various 
aspects of the aJgorithm The examile is from [ "'I] 
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xa ^ole ? I 


Let 


vvhG""e = i a 


= 2 0 


b 3 = 0 5 


b 4 = 1 0 


and 


X 


1=1 


x ^) 


1 5 


b 6 = -3 0 


brj = Ob 


7 7 7 

-2Eyb+i, Lxxai 

13 |i-3 


1=1 


1 1 


“o " ^ ®1 


g = 2 


1-1 j=i 


0 J 32 = ”0 25 


tage 1 ^l^^l 


7 t ke +1 or -1 values 


Xy ) 


Ul(/i X 2 X 3 ) = - 2 Xj^b^ + 2 Xj^ L ^i®l l-i j '^l®o 


^ l "'! 


a - i -^ ll-i 


1 2 

= -3\j^ + 2/j^[0 5 2”0 25 X 3 J Xj^ 

T ble 3 3 IS obi ineU by uetornining th value 01 X 2 that 
minimizes for a fixed X 2 and Xj 

Table 3 3 Stage 1 


X 


U , 


■1 

•1 

1 

1 


1 

1 

1 

1 


1 

1 

1 

J 


-5/2 
-3 5 
-0 5 
-1 5 
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Since 

stage 

Stan 


= 1 for all th values of X 2 we can decide at this 
itself that the fust vaiiabl is = 1 


*^2 ^^2 ^3 ^4^ ~ -2Xr^hry + 2x 


2 2 


h \ a 
-T 1 


1=3 


12 i| 




Ui(y2 ^3) 


As the calculations arc dentical in all the stages we 
have presented th f ncd results in Tabl s v> 4-3 8 correspond- 
ing to stages 2 to 6 


Table 3 4 Stage 2 




X3 X 


4 



“•1 

1 

1 

1 


—1 

1 

-1 

1 


1 ^4 

1 -5 

1 -3 

1 -4 


Therefore the second variable 

X 2 = 1 


Table 3 5 Stage 3 

^4 ^5 ^3 ^3 

-1 -1 1 -3 5 

-11 1 -4 5 

1-1 1 -45 

1 1 —1 '“\j o 


Table 3 6 Stag 4 



-1 -1 1 -6 
-11 1-7 


1-1 1 -3 


111-4 
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Ta Ic 3 7 Sta^e 5 Table 3 Q Stage 6 



-1 -1 

1 

-7 


1 

-1 

9 

5 


-1 1 


-6 

5 

1 

1 

-12 

5 


1 -1 

-1 

10 

J 

1 

-1 

-2 

J 


1 1 

1 

9 

0 

1 

1 

-1 

5 


From Taoi 

3 o 

AQ 

th 

t > • 

0 

= 1 ano 

= 1 

On 

back 

ubsti tution 

Ta lie 

1 

giv s 

X = 

0 

1 It may Is 

b not 0 hat 

Table 3 ^ no 

labl 

3 7 

or stage 4 

and 5 r 

soectively 

diioc tly 

inoica+e hat 

II 

1 and 

i- 

y = 

-1 

ising tho 

values of 

and 

in Table 3 

we 

obtd 

n X3 = 

= -.1 






^ o VIThRBI LbOPITHl FOR iINI lIZIi G QF 

Foi th^ purpos of co oar son we hav given a bii f des 
craptioo of VA in this section 

R call that the ^TQF nin "nization p obJcm arose in 
conn ction with Iran is ion ii digit 1 can through a finite 
imi ulse respons han modelled as finite oino y transversal 
•^iltcr 

At tho kti nnstart he outout of su h ilt r can bo 
repr sented in terms pu Xj^ ^k-l '^k-g 
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H = 


q 

E 

1=0 


h X, 

1 k-i 


k - 1 ? 3 


vjh r g IS +h mcnory o h transvrr dl filter Thus Yj, i a 
functioi of the pi sent input as vyell a the previous state of 
h transversal filter Let denote the tate of the trans- 
versal flit r at th V th ii tan Th » 

^k "" ^^k ^1-1 g+1^ ^k ^ if k < 0 

In t rms of s yj can be expressed a 


Vk = '’l 




Th lefoic given nn inpu sequence {Xj^} wo have a correspond- 
ing st t sequence and an output sequence This 

CO rospondtnee is one to one This observation d crucial 
to xhe developmont of VA Due to this corr spondence we can 
ninimize F(x) ov r S|^ s instead of Xp. s For this purpose 
decompo c F(x) as 

n m ft 

F(x) = n(x) = [-2 


Note bhat the quanxity in ide the second oaa r of brackets is 

^gi-l 


only n function of x^^ x„ •, Le 


fn (x) = >^1 (>«i 




’‘n.) 



^8 


It IS easy to see that ~ ’^l^^g+1 

Nov Vj^ can be si ilarly decomposed a 

''l<’'2 "3 = '2(='3 ’'4 ’'m' + “2(®g+2 ^g+j) 

In a similar fashion we can wra te for tho kth stage 

^k^^k+1 ^m^ ^k+l^^k+1 ^k^^g+k ‘^g+k-l^ 

k = 1 2 3 mg 

Therefore r(x) can be wld t en as 

n-g 

F(S, & ) = £ Ui/(S .L, S ,, 1 ) + /„ 

'12 Ti'^ k g-*'k g-^k-1 m g' m' 

wher 

g+k 2 

'^1 ^ g-rk ■^g+k-1^ ^^k j k-j | ’’'^k^o 

k = 1 2 3 m~g 

IVe wish to note that the derivation of the foregoing recur- 
sive equations is baseo on the approach given by Hayes [41] 
The optimality of th algor thm follows ■'^rom Lemma 3 1 

The algorithm works as fol]o/s In the first stage of 
the algorithm S^) is maniniz d with respect to for 

fix d ^ ^g+1 assume anyone of the states we 

have to s ore value corresponcinj to sta es As 
and differ in only one pi ce d ternination of optimum 

giv n IS off'^ctively one Vdriab3e optimization To 

complete our discussion let 
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r(s. 


Sm) = 




,^^2 ^g+k-l^ ^ 


Hence 


min fjL = min 
•^g ^g+1 


m 


^Ic^^g+k ^g+k"l^ ^ 


■"J" 


Define u' = u^(Sg^^ „)^) u* = 0 


Th n "Lh recur i /e e uations for /A an b vritten as 


4 = ^" f-'k'^g-.l Vk-l' “k 1^ 

g-rK-l 

Finall/ the ootimum Vdlue of F F i g ven as 

F = min [u_ ^ v„ _ (S„)] 
m— g mg m 

m 

Result obtained by apolying VA to E a nple 3 1 is snown in 
he F-gure 3 1 In t e ficure have shown the survivor paths 
hrough the trelli In h figure dotted lines indicate alter- 
nate survivors giving same function values From the figure it 
nay be noted that (11) i node common to all the survived 
paths in stage 3 Th s iiplies that ~ 1 Thus decisions 
regarding data can be maac ven before completing the forward 
"ecursion process This is due to the merging of the urvivor 
o ths through the Trellis 




Let us now consider the solution obtained by applying 
flL“*RDA to Example 3 1 From the Tables 3 3-3 8 w can easily 
see that = 1 Sirailarly table given for stage 2 gives 
X2 - 1 The third stage shows that Fourth stage 

gives X4 = 1 and fiftn s cage = -1 These aspect do not 
become clear from the Trellis diagram siown in Figure 3 1 

3 4 TRATECICS FOR REDUCING COMPUTATiO AL AND STORAGE 

RCQUIRBilENTS 

Throughout the discussion of tb recursiv deconvolution 
algorithm we have used tables to hov/ the results obtained at 
each stage of the algorithm In actual practice su h tables 
are not necessary Notice that the ta) le used in the first 
stage is used only by the second stage Therefore in, the 
second stage mq can use the updated v rsion of the first table 
For the purpose of illus oration w have shown the development of 
the tables for Exanple 31 in Figure 3 2 Back substitution 
givGs the path snowing dotted lines in he figure It is obtain 
ed as follows and x^ ar decided by noting that is 

min mum at that point x^ for the state (x^ x^) ~ ( 1 1) is 
-1 X4 for the state (x^ <^) = (-1 1) is 1 for the state 

(^4 ^5) = '-l)is -1 X2 and are obta ned similarly 

As the piocedure is same for a general n-vaxiable BTQF we 
sec that the storage requirom nt is registers of length (m+1) 
arh for storing s at each stage and tho accumulated minimum 
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S taae 

1 





Stage 

_2 




^2 






^2 

^3 "^4 

^2 

1 

-1 


-1 

- 

-5/2 

1 

1 

■1 -1 

-^4 

1 

-1 


1 


-3 5 

1 

1 

•1 1 

-5 

1 

1 


-1 


-0 5 

1 

1 

1 -1 

-3 

1 

1 


1 


-1 5 

1 

1 

i i 

~4 

Stage 

3 











"l 


•st- 

^2 

^3 


^5 

■J; 

^3 




1 


1 

1 

1 

-1 

-3 5 




1 


1 

1 

-1 

1 

-4 5 




1 


1 

1 

1 

-1 

-4 5 




1 


1 

-1 

1 

1 

-3 5 


Stag 

6 









* 

^1 

X2 

^3 


^4 


^6 

^7 

^6 

State 

1 

1 

1 


1 

-1 

-1 

-1 

-9 5 

-1 -1 

1 

1 

1 


1 

-1 

-l“ 

1 

-12 5 

-i 1 

1 

1 

-1 


1 

-1 

'' l" 

-1 

-2 J 

1 -1 

1 

1 

-1 


1 

-1 

1 

1 

-1 5 

1 1 


Figure 3 2 Developm nt of the tables in ML-RDA for Example 3 1 
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Vd^ue at every stag Thus the storage requirement gro 
linearly viLh the bio k length Further since at every stage 
e need function evaluations the computational comolexity 
of the Igorixhm gro /s linearl/ with n'ock length ard exponen- 
tially vjith ch nnel me ory 

Even with the foreaoing strategy for storing the tables 
t e alg rithm still re iires a large amount of storage ana 
computations foi even mod rate block lengths Thus if th 
recursive algorithm is to b come acceptable it must hav 
additional features fo-^ minimising storage and computationa] 
require nents Towards this end w now propose and oxamino a 
method for reducing the complexity of Ml-RDa v^hich is evoected 
to ro ult in a greater savings in storag and computations 

To b gin with let us examine Taoles 3 3-3 8 -^or Examol 3 1 

For instance consider Table 3 5 obtained at the 3rd stage 

* 

Note thax if v/e are able to /press x^ as a function of and 
x^ substi uting for an tho objective function eliminates 
the need for the table in th*^ n xt stage comoutations Moreover 
for tho purpo o of b ck substitu ion we need retain only the 
functional form of x^ In this case it is eas/ to sec that 

If it every staoe we are able to obtain such simple 
r present tion stoi go rtquir ments are reduced to a minimum 
In the example under consideration all the func cions have sin^de 
representations as given below 
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tag ] 2 3 5 6 

Functions ^=1 yp=l X 2 =-X 4 ^4=1 ^5"”^ ^6” ^ x^=L 

ou h 1 pic functional for is cannot always be guaranteed 
For tho ire leing s unie that such representations ar possible 
Then tie next qucsti n v/ould be cm we arrive at the rurct onal 
forn vjithout nufiorating all possible values of the fi x d 
van 1 s? If tais i possible n woulc a3so h v achieved 
reduction in the computational co oioxit/ 

However in g n ral this ppears to oe a difficult pro- 
bio In the fir t ploc funccit \ 1 form of may be coraoli- 
cat d duo to which storag f uch func on as v^n a substi- 

tj ion irt tho objoctiv functioa may b difficult Seconoly 
1 + may bo difficult to directly obt r the functional forms 
Therefore to bejin with Dnstead of considering the most 
general ca e w study th binary case in ch icxt soc un 

4 1 Binary D \ta Transmission 

Vh n the data symbols assume on of th two values 1 or -1 
the objective unction can bo converted into another function 
called ps udo olean function (PBF) [57] which is a function 
of Boolean variaMos v^^irh re 1 coe ficients For this we us 
tho tr nsfornafci n y = (l+x)/2 (which mo ns y takes 0 nd 1 os 
X trtkos “1 and 1 resp cti/oly) With tho help of this t'^ans- 
ornation the qu dratic function F(>() can b-^ coavort d into a 
PBF F(jj;) wher y^^ y 2 yjj^ are Boolean variables 


Le F(y) expressed in the matrix vector form as 


F(x) = ”2x^b-^<^ 


]e use th transformation ^ = (l+x)/2 


where 1 is a vectoi of all ones Vith this t an for lation we 
obtain 

r(^) = + 1 A y + p 

v;here b == 2(b+Al) A = 4A p = 2l^b+i^ «il+r^x 


The con tant term o can be 3 r lored fo’>' he ourpose of 
rni mini zing F(;^) 

r{y) IS sale as r(>() Therefoi the 1L-*PD<\ given in 
S ction 3 2 applies to this case with the di'^ference that 
the tables at each tage now contains Boolean variables As 
OUT- interest is in xpressing in terms of ^i+2 ^itg 

at the ith stage vve observ that the table in this case is a 


truth table for in terms of ^i+2 


^i+g using 


re ults from the theo y of Boolean functions [72] \J6 can repre- 
sent x^ in sorie convenient form For ins ance minimal sum of 
produ t or product o sums form 


Ttus we have shown that in the cas® of oinary data there 
e<ists a procedure for expre sirg x^ in t ms of ^i+2 

^i+g stage Howe/p^r simple expressions for may 

not always be obtaineo Let us consider tho worst case where x^ 
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IS rcor sented in terms of ^ The truth tabl 

or will contain 2^ ntries In this case h stor ge can 
be reduced to some extent by obta_ning a mi imal represents 
tion of x^ [ thods such as Quin'^-ricClausky oi any such 
similar m thod [72j could oe used for this puipose Hov^ever 
/c may lave to use a special purpo c compute'^ vhich imolement 
Boolean function mininization algor thm 

Now VC cons dor rhe probl m of obtaining unctional ropre- 

^ Q 

senta ion for withou enun ating all po ible 2 cases jy 
using an algorithm d vc loped by Hammer et al [57] we show that 
the computational conplex ty can be reduced at very stage 
vithout sacrifying optimality Towards this end we use 
L miin 3 1 to derive a r cursive algorithm developed originally 
b/ Hammer et al [o7] for minimizDng nonlinea PBF s in the 
next section Tho approach taken here i much sinoler corrpircd 
to tho derivation given in [oT] 

3 4 2 Minimization of Pseuio-Boole n Functions 


Consider a PBF ^2 variables Since 
pseudo-Booloan function is linear in each of its variables wo 
can write 




>-3 X + 


V 1 ( Xrj X^ 


m' 
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Application of Lemna 3 1 qiv^^s 


min 


Fj = nin [V;i(>'2 X3 Xj^) + 


m 


m 


min Xj^ ^3 


m 


Now since x s are Boolean variabl-^s it follows that 
1 

> 0 


) = O 


m 


x^) < O 


0 if ^ 1^^2 ^3 

0 if ^ 1(^2 ^3 

_ 1 if ^1.(^2 

where 0 is a don t care v/ariablo (Xj^ arbitrary) 

Therefor a Boolean function representation ror x^ can be 
obtaineo by determining those X 2 x^^ for which < 0 

oubstitution of Xj^ into gives The other stages of the 

minimization follow the sane pattern as in the case of recur- 
sive procedure described earlier Thus at the ith stage we 
have 


min F = 

X X ^ X , , X 

1 m 1+1 m 


mm x^+2 


m 


mm X3^,2 


%)] 




1 

”■ 0 
i 

if 

^1 

> 

0 


1 0 

1 

H 

D 


0 



IX 

^1 

< 

0 


and 
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\s we are interested in only one solution 0 can be fixec. 
as 0 or 1 and we can solve < O or obtaininj or _> 0 
xor obtaining Hanimer et al [57] have also develooed an 

algoritnn or determining all solutions whicn satisfy ^ 0 
This algorithm can be used to reduce the computational cornple- 
t/ a each stage 

From the foregoing discussion it is clear that in the 
binar/ case it is possible to r duce storage and computational 
comolexit/ of the RDA if fast processors are available for 
minimization of Boolean functions and for implementing Hammer 
t al orocedure for obt ining 

It may be noted that determnation f iini lal reprusenta- 
lon of Boolean functions is a c^as ical proolom in the theory 
of switching functions Although a large number of methods are 
available [72] no dofinito claim can be. nad in favour of one 
approach over th^^ other 

In summary the. over 11 effici ncy of the if impl - 

m ntod in the manner described in this oction depends to a 
great extent on the availability of fast algorithms for 
obtaining minim 1 ropres rtations for x^ either in the Boolean 
func ion form or in the pseudo-BooJ an function form 

In the nonbinary case however no scch claims can be made 
This aspect needs furrh r investigation 



59 


3 5 P^CURSIVE ALGO. ITHM FOR DPCODING BLOCK ERROR COPRECTING 

CODES 

As an application of the recursive algorithm developed in 
the previous sec cion we consider maximum likelihood decoding 
of binary block codes Our approach consists in formulating 
the iv\L decoding pro) lem as an equivil nt probler of minimizing 
d pseuao-Boolean func ion of several variables It may be noted 
that the algorithm oe / loped in this section can also foe used for 
maximun likelihood occooing of convolution cod s 

We wish to note hat Volf [73] has studied the applica ion 
of V/ to decode blocl cooes by con trusting Trellis dD agraras 
The loproach consid r d here doe not require Trellis constru- 
ction and it seems to provide a irore general method for maximum 
likelihood decoding of binary block codes 

The codes considered here are over bF{2) where GF^2) 
denotes Galois field with two elements 0 and 1 [72] For such 
codes the ML decoding is qui valent to solving th set of linear 
equations ^x = ^ over GF(2) such that the Hamming distance 
between G){ and r is mininum vjhen all the code words are assumed 
to equiprobablG The matrix G is called the generator matrix 
of the code in the parlance of coding theory [6] [7] The 
received vector r is an additive combination of the transmitted 
codevector which is not observable at the receiver and the 
noise vector w That is r = c 0 w where 0 denotes addition 
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operation in GF(2) It may be noted that tht_ lements ot i 
and w are e ther 0 or 1 We also assume that is an nxm 
m trix 

The Hamming distance between two vectors x and ^ over 
GF(2) is defined as the number of nonzero entii s in x 0 
It IS also known as the weight of ^ 0 yd noted as 0 y) 

Since GF(2) elements are also elt.m'^nts the real field 
we can show that 

whore p denote pointwise multiplication ^e now make use of 
the property that if y s 0 1 real vector then 

w(x) = 

whore 1 ds column vector of all ones Therefore it is easy 
to see that 

w(£ 0 £[) = w(p+^-2£ = w(p)+w(q) 2w(p 

Thus maximum likelihood decoding oroolom can be formulated as 
mn(w(Gx)^ w(r)’-2w(G^ r) ) 

X ” “ 

== min(l^Gx+l^r-21^(G^ r)) 


(3 6) 
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'Joxo that Gx IS to be computed ov r GF{2) Therefore 
we n ed a suitable representation for th elements of Gx Let 
32 aj^ denote n rov/s of G Then we can write Gx as 

(aiX ajX a^x) wh « a^^x = a^^ ^je«a,2>'2 ® 

// c n US the r lation 


u @ V = u+ / - 2uv 


(3 6) 


in ord r to con/ert a^x into n equival nb ps udo~Boolean 
function However uch a representation boconos too comoli 
catod Afh n more variables re involved A more comoact form 
of representation is n c ss to obt n a ri-prcsontation which 
reflects the gon rator matrix exolicatly Towards that end 
consider the transform tion u = l-2u and v = l-2v Substi~ 

tuting for u and v on th right hand sido of (36) w obtain 
u 0 V = (l«u V )/2 which IS a mere compact expression 
comparoQ to u+v-2uv Ve can furth r show that 


u Ct) V ^ w = (l~u V w )/2 wh re w = l-2w 


m m 

In g n'^ral W'^ have S c x = (1 - % )f2. where denotes 

1=1 1=1 


summation in GF(2) and c^ € GF(2) i = 1 2 


and Now for x we have 

1 m a. 

( 1— z 
j=i ^ 


Sli - 2 


( 1 - 1=12 


m 


ij, 


if 

^ 

if 

^3 "" ^ 


m 
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WotG that thG representation for a^>c clearly shows the 
ffect of a s 

^ sJ 

ooing oacl to tho minimization problem given by 

T 

(3 5)// can ignore 1 r for th purpos of minimization as it is 
a const nt The rest of the toims can bo combined as 


T 

rnin (l^Gx r ) 

X 

Let d = (dj^ dg 
Then ux = ^ (l“d) 


wh rc r = l;--2r 


T 

d ) whore d 
n j 

Th re fore Gx r 


m 

It 

1=1 

1 

2 



3 

1 

2 


= 1 

d r 


2 


n 


Thus we have to find 

min (- 2" r )) = min (- g- 2 <^,3: ) v/hore r = l~2r 

With the objective function in this form we can now 
proceed with the r cursive optimization algorithm iscussed in 
Section 3 4 1 To round up the for going aiscu sion v/e give 
thro illust-rative examples 


Example 3 2 
given by 


(Hamming Code) 



0 

1 
0 
0 


0 

0 

1 

0 


o 

0 

0 

1 


Consider the generator matrix G 

110 ; 

10 1 
Oil 
111 , 
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T 

Let X = (1 i 1 0) be the transmitted vector Then 

c=(l 11000 0 )^ IS th transmitted code v ctor 

T 

L tr= (0110000) be the received vector For this 
situa ion we have 

'^l " ^1 '^2 ^ ^2 *^3 ^3 ^^4 ^4 ^5 “ ^ 1 ^ 2^4 

d^ = and Oj ~ Z 2 Z 3 Z 4 

Therefor the function to be minimized is given by 

f(^) = “ 5 ^ ^l'“^2~*^3^^4~^1^2^4^^1^3^4'*'^2^3^4^ 

Negl cting l /2 we can write f(z) as 

f(z) = Zj^{“l-Z 2 Z 4 -Z 2 Z 4 ) ~Z 2 “Z 2 +Z^+Z 2 Z 3 Z 4 = 

^l^^l ^2 ^3 ^4^ ^ 1^^2 ^3 ^4^ 

\^inimization of Uj^ with r spect to Zj^ for fixed Z 2 z^ and 


giv s the following table for stage 1 

Stage 1 Stage 2 



~1 

-1 

-1 

1 

“3 

-1 

-1 

-1 

-3 

-1 

-1 

1 

1 

-1 

-1 

1 

1 

-3 

-1 

1 

-1 

1 

-1 

1 

"1 

-1 

-3 

“1 

1 

1 

1 

-1 

1 

1 

1 

-3 

1 

-1 

-1 

1 

-1 

— . 



— 


1 

1 

1 

1 

~1 





1 

1 

-1 

-1 

-1 





1 

1 

1 

1 

-3 
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In terms of Uj^ we can write f( as f(^) = U^(z 2 z^) + 

Z2(l“Z2Z^) + z^—z^ 


Minimization of f(z) with resp ct to gives the table for 

* 

stage 2. Note th t U 2 is independent o-p and IheT-efore 
f(z) = Minimizing finally with respect to z^ and z^ 

we obtain 


f{z) ~ ~o when Zg = -1 and z^ = 1 which on back 
substitution gives z^ = -1 and Zj^ - -1 Therefore we obtain 
(1110) as the recovered data vector 


Example 3 3 (Reed ^Auller Cod ) Consider the generator matrix 
given by 


11111111 

01010101 

r^T _ 

^ 00110011 

0000111 1 

T 

Let X = (1 1 1 1) bt the transmitted vector 

c = (1 0 0 1 O*' 1 1 O^) and r = (l 0 0 1 1 1 0 O)"^ 


In this case the function to be minimized is given by 

f(z) can b vjxittcn as 

f(z) = ^ C-z^ + 7^Z2+Z2^Z4-Z3^Z3Z|)+ ^ ( 2l“^1^3+^1^4 ^1^3^4) 
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For this casG the table obtained for the first stage is shown 
below 


tago 1 


"1 

^3 

^4 

* 

^2 

^2 

1 

-1 

~1 

-1 

-2 

-1 

-1 

1 


0 

-1 

1 

-1 

1 

-1 

-1 

1 

1 

0 

0 

1 

-1 

-1 

1 

-2 

1 

-1 

1 

0 

0 

1 

1 

-1 

0 

0 

1 

1 

1 

0 

0 

N ote 

that 

in tho 

first 

stage 


U^Czj^ Z3 Z4) = min 2^ 

^2 


Zj^ also can be consid red as tho f rst stage variable 

From the tabl it is not difficult to s e that z^ = 
Substituting Z2 m f(^) we obtain 

1 

^2^ ^1 ^3 ^4^ ~ 2 (l-Zg+z^-z^z^ ) + 2 

Tabl for th second stag minimization is given below 
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otago 2 


"3 

2 . 

4 

fr 

"1 

^1 

-1 

-1 


0 

-1 

1 

~1 

-2 

1 

-1 

0 

0 

1 

1 

0 

0 


From the table it is easy to see that Zy^ ~ Substituting 

for in ^2^^! ^3 ^4^ obtain 

£3(73 24) = Z3-I 

Therefore we obtain ~ ^ ^4 “ ^ ^2 ~ ^ ^1 ~ 

where 0 d notes eitner 1 or -1 Thus the maximum likelihood 
solutions are 

(-1 1 “1 1) and (-1 -1 -1 1) 

The corresponding 0 1 vectors are (l 0 1 O) and (1111) 

Thus although the transmitted vector is (ill 1) we obtain 
( 1010 ) also as a solu ion This is because two errors wer^ 
introduced in the code vector at the places indicated by * 
in _c The sane received vector r can be obtained by introducing 
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two rrors in the locations 2 and 4 of the code vector 
obtained by (l 0 1 0) as shown below 

Cj^=(ll 00 110 0)^ 


Example 3 4 Con ider the generator matrix given by 



110 111 
0 0 110 1 
0 0 0 0 1 1 
0 0 0 0 0 0 
0 0 0 0 0 0 
0 0 0 0 0 0 


oooooooooo 

1100000000 

0111000000 

1101110000 

0011011100 

0000110111 


T 

s can be obtained by reading columnwise in G and 
associating s whenever 1 s are encountered For instance 

w obtain by noting that the last column contains 1 in 

the z^th position Therefore d^^^ = The objective fun- 

ction IS then given by 


f(zj_ Z2 



1 1 

^ ^ ^ Z ^ Z 1 Z^~i“ Z 1 Z^"* 


Z4- Z2 7 ^ Z4- Z3 Z^ Z3 24 Z^ - Z4 Z^- Z4 Z^ Z Z5 - 

T 

where we assume that the transmitted vector is (0 1 0 0 1 0) 
c = (o"^ 0 1 1 u 1^ 1 1 1 1* 0 1 i 1 0 O)^ 
and r = (1 0 1 1 0 0 1 1 1 0 0,1 1 1 0 0) 


Note that 3 errors occur in this case 
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Now carrying out the steps of the recursive algorithm we 
obtain th follOA/ing tables 

Stage 1 Stage 2 


Z 

^3 

^1 

a 

^3 

^4 

^2 

Jir 

^2 

1 

1 

1 

1 

1 

1 

1 

“4 

1 

-1 

-1 

-3 

1 

-1 

1 

-2 

- 1 

1 

1 

1 

-1 

1 

0 

-2 

-1 

-1 

1 

-1 

-1 

-1 

1 

-2 








Jh 

il 


23-Z2Z3 

) 

U2 = 

22 ( 1 + 2^' 


In stage 2 

it IS easy to note that 23 = *"232^ 

4 if we 

put 0 ~ 1 

Stage 3 



Stage 4 





* 

* 





^4 

^5 

^3 


^5 

^6 

"4 

^4 

1 

1 

-1 


1 

1 

-1 

-4 

1 

-1 

1 

-6 

1 

-1 

1 

-6 

-1 

1 

• — 1 

"Sl 

-2 

-1 

1 

1 

~6 

-1 

-1 

^2 

2 

-1 

-1 

1 

-6 

c 

il 


[ 

2 

^4 = 

4 6 *^ 




(N 



69 


if 0^=1 and 02 = 

Stage 5 


^6 ^5 ^5 

1 -1 -8 

-1 0 6 

Tracing back through the tables w-^ obtain 

^6 = ^5 = -1 ^ 1 ^3 = ^ ^2 = -^ 4 ^ 

Therefore th maximum likelihood solution vector is 
(0 1 C 0 1 0)‘ which IS thG transmitted data vector 


^6 = -2^6 '•'J5 
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CHAPTEP 4 

DhCIolON FhCDBACK DECOMVOLUTXOK SCHC lES 

In the previous chapter derived a HL RDA whose 
computational complexity and stor ge requirements grovvf linearly 
;/ith the block length and exponential!/ with th channel memory 
We &hov>/ed that attempts to further alleviate computational ard 
storage requirements in th binary ca e lead to minimization 
of pseudo Boolean func ons which in general is a rather 
difficult problem The computational and storage requirements 
how ver can be reduceo if one is willing to accept suboptimal 
ch mes Towards this end in this chapter wo con ider the 
possibility of incorporating decision ecdback idea for 
recov ring data in BDi systems \}g propose and analyse four 
cecision feedback data recovery (DF~DR) schemes All these 
s lemes are based centrally on the idea of nonlinear Gaussian 
olinination method described below 

Consider the receivod vector r given by (27) 

r = Hx + w (41) 

Under the assumption or r al valued data and white Gaussian 
noise the ML data vector is obtained by solvina 


h'^Hx = I’^r 


(4 2) 
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One method of solving (42) is to use the Gaussian elimina" 
tion (GE) algorithm which consists of forward elimination proce- 
Jure (in which H rl is roducod to an upper triangular matrix) and 
back suostitution (in which the solution is obrained by recursi 
vely sol/ing th resulting set of eouations) Now we can incor 
poratc tho discr.^to nature o data symbols into GE algorithm in 
the folio /ing n nner Vhile back suostitutin instead of using 
the calculated valu s daroctly we can us tho value obtained by 
passing the calculated valu th ough a nonlinear d cision 
device which assigns an approprioto valu from the finite 
alphabet Since this proc dure j.n /oive in reduction of a non 
linear device between tie fo v/ard elimination and back substi- 
tu ion stages the method s called nonlin ar Gaussian olimina- 
ion 

This chapter is organi7ed as follows In S ction 4 1 we 
us Cnolesky decomposition t chnique co derive a DF-DR scheme 
which does not tn c noise variance into account oec tion 4 2 
gives a DF-DR sch no which minimizes moar s (uare error between 
tic actual data and its estimat'^ A numcricall/ stable DF DR 

SCI mo IS derived in Section 4 3 This cl enc is based on the 

minimum property of Fourier expansion in unite Jimensionai 
Hilbert spaces In Section 44a Dr-DR sch m is derived by 
modifying Austin s fl3] assump ions regarding decision feedback 
equalizer for CSDT sysi,ems Ir S ction 4 o show that the 
modified jHUstin s oproach is ai so ossen iil^y equivalent to a 
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nonlinear Gaussian elimination method In S ction 4 6 at© list 
some observa ions on the methooology used in this chapt r for 
motivating the idea of decision feedback 

4 1 OnCI ION FEEDBACK SGHBvlt USING CHOLbSKY DECOMPOSITION 

Cholesky cecompo ition technique [74] deals with decompo- 
sition o positive definite matric s into product of nonsingular 
lover and upper triangular mitrices If V denotes a lower tri- 
angular matrix /;g can write as 

= V^V (4 3) 

Using (4 3) (4 2) can be written as 

V^x = 


This IS equivalent to the forward elimim ion stoo of GE algo- 

T 

r thm Since V is an upper triangular matrix estimate of the 
last elonent of x is obtained as 


ro 





1 T 

where is the mth elemert of c - 7 ri r and is the 

T 

1 h diagonal cl ment of V Now let be the value obtained 
by passing through a decision device use instead of 

Xj^ for calculating given by 


CO 

X 




'm-1 


'm 1 m 


1 m *^ ' m-1 


m-1 
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Now t ^ data d cide \ on the basis of 

Using ^ ana '^n-2 cnlculatGC This proc dure 

IS continued till Xj^ is obtained 

In the foregoing apiroach la t data o th block is re 
rccovei d first her as in h c s of dcci ion f dback data 
r cov ry scl nes fo-" CoUT first data is recovered first 
U hough v/hich da a value is recover a first i imm terial 
in t G case o BDT for the sole of uniformity we incorporate 
thi feature of CSUT systems in th follojvino manner 
T 

H F can also be written as a product of upper and lower 
triangular natrices That is 

h'^H = (4 4) 

where U is the uppei triang ilar matrix One method o 
ohtnining U is as -^ollows 

Let = h’^H and A„ , = U^ ,ul , 
m m 1 ni~ L ni"! 


Th n and can be written as 



^mm ‘^n-l 



Y 

T 

— ra~l 

^m = 

! 

1 

1 

B 

J 

and U- 

I 1 


O 

''^m-l 

Then 

r 

2, T 

' -I 

T r 






i 

U ,0^1 
ii-l ri-l 
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Therefore y = Ca^-4_ie„ and 

Therefore 

Note that y is real because det(U^U^) =: det(Uj^__jl^)^ y^ 

= det(Aj^) 

and Ajjj IS a positive definite matrix In deriving the recursive 

form for U we have follov ed the method given in [74] (see page 
423) 

In terms of U /e have to sol /e 

U^x = ( V 5) 

where U is a low r triangular matrix The procedure of 
recovering data begins '\/ith the estimation of first oata Xj^ 

1 ich IS given as 


Xi = Z;l/u^i 

-1 T 

where is the first element of ^ = U Hr is obtained by 

passing through the nonlinear decDsion device Then X 2 is 
obtained as 





= I ZJ d2i'5?^)/u22 


We continue this procedure till x^^ is obtained Figure 4 1 
gives a block schematic of the data recovery scheme Jas d on the 
procedure just nov; outlined In the figu e u^ denotes the ith 
row o-^ U and v^ d<^not©s ith rov^ of U -D wh ro D = diag(u , 

Uj^) Although u^ and are shown stored in separate register 
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FIG 4 1 Block diagram of the data recovery scheme 
for BOT using Cholesky decomposition 
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banks in the figure in ail a set of m registers of length 
ni are sufficient 

Processing of each block consists of m cycl s In the 
figure wo have shown the status of various registers for the 
kth data recovery For the next Jata takes the 

place of Vj^ and take the place of u^^l^ becomes 

'^k+1 k+1 cycles the in tial state is restored 

and the processor is ready to d al vath the next block The 
inner product computer shown is the major compuxation block in 
the scheme In the case of binary data tl inner product 
computei used in the feedoack loop ooes not require multxpli 
cations 

Computational requirements of OF DP sch n for BDT using 
Chole ky decomposition method is same as that of DF-DR schene 
for CSDT if the block leng h is equal to the number of forvard 
tap On th other hand the scheme shown in Fic 4 1 requires 
more storage compared to DF-JR schemes for CSDT syst m$ How- 
ver with the present day t'^chnology storage requirement is 
not a crucial factor Whereas long bursts of error in the 
ense of CSDT due to error propagation especially in the 
medium S-JR range is definitely a matter of concern In the 
case of DF“DP scheme for BDT systems error propagation is 
restricted to a block length in the worst situation 
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Analytical e/aluation of the performance of DF-DR schemes 
IS di ficult due to the presence of nonlinear decision device 
However some idea of p rformanc can be obtained under the 
assumption of error~free feedback In this case probability of 

ith data symbol being in error (PER)^ is given by 

CO > 1 y2 

(PER)^ = 1/2 e ^ dy = Q(f^oNR)^) (4 6) 

(SN^)^ 

^hcr ^12 

Q(x) = ® ^ ^ 

(Sr can be computed as follows From (4 b) we see that the 
effecti/e noise vector is given by 

w - U~^h"^w 

Therefore SNP associated with ith data symbol is given by 
(SNR)^^ = 

2 “•It 

wher j |u^ j I denotes squared length of the ith row of 

and Nq/2 is the no iso variance 

4 2 WSE DECISION FEEDBACK DATA RECOVER/ SCHu E 

In the previous section we described one method of 
obtaining the parameters of DF~DR sch me using Cholesky decom- 
po ition in which we did not take noise variance into account 
We now derive a DR schem eased on mi ii num mean square 


2 X 
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error (iVii'lSE) criterion This scheme accounts for the noise 
variance 

Ve first define several vec ors and matrices which will be 
used in the following derivation 

b = 

X, = Xg X^ 

''k “ ^''k 1 ''k 2 ''k k-1^^ 

'^k ” k '^k 

= H with first 1 1 olumns removed 

hj^ = kth column of H 

- H with first k-l columns 

The objective is to obtain a set of coefficients ^ 

■^k ktl “k m ''kl Vfc 2 K-l such that estimate 

of the kth data symbol given by 

^k ~ \ k \ m ■■ ^k 1 ^1 “'^k k-1 ^k~l 

(4 7) 

IS closest to th actual data Xj^ in tne mean square sense 
That IS 

MSEj^ = ^ minimum 

Here E[ ] denotes the standard exp ctation operator Using 
th principle of orthogonality in v'lSE minimization [7] wc 
ootain 
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FCej^b^] =0 3 = X x+1 


m 


and l[ e ^ ^ 


1 2 


k 1 


where ej^ = ^k“'^k Using the fact that 
we get 


hj Hx + h^ w 


E[ej^b^] = E[(ujHjhx + uJHj^w - \ijxj^ Xj^)(h^Hx + jnjw)] 


ujHjHHfhj 


^ ~k'*k- j ° ° 


3 = k k+1 


n 


(4 8) 


Similarly c[ej,x^] =0 gi /es 

= 0 1 = 12 


TuTu 

^k^kiii 


V 


k 1 


ki 


m 

= S u 
j=k 


kj ^j~i 


where a 


j~i 


k-1 


hj 


In th matrix vector notation 


'^k "■ \^k^k 


(4 9) 


Substituting (4 9) in (4 8) and rearranoing terms we obtain 
U|, = [hJ[HhT + ^ I - hJu,, 


N 


= [hX . H'l H,^h 


But (hJ Hlhy = (1 U 


‘k^k 

o)T 


(4 10) 
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Therefore Uj^ is obtained as the first column of 



Fin lly the resulting MSt associated with the kth data is given 
by 




-E[e|^x^] 


I = 1 - 


m 

z 

i=k 


u 


\ X 1 V 


a 

^ 1 ^ Z a ^ (4 11) 

J „0 -J J 

The irean square error given by (4 il) reflects to a great 
extern the qjality of ne DR scheme It an be consid‘^red as 
a mea ure of the performance for it indicntes the variance of 
the error If hSE is significant probability of the kth data 
symbol being in error is large Thus l/(WSE)j^ may be considered 
as a measure of effective SIIR associa ed with the kth data 
symbol 


Comoonents of u. can be computed recursivoly u ing Trench 

T 

algorithm [75] because the matrix ij is a positive 

definit Toeplitz matrix First mb cal ulate given by 

T -1 

T, “ ^ I ) 

mm 'mm y 


wh'^re hIh = hlh„ = h? -r h? 


m m 


■m' rr 


‘g 


The oth r Uj^ s k - n-1 m~2 1 can be recursively 

obtained by followang the procedure given in [7b] Thus the 

O 

computational compiexi’*’y is 0(m ) as the procedure for 
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calculating Uj V = 1 2 m is same as inverting a mxm 

positive def nite Treplitz matrix by Trench algorithm The 
implementation scheme is same as the one shown in Tig 4 1 
except that and v^ are given by (4 9) and (4 10) res- 
pectively 

4 d DECIqIGH FELDB/^CK SCHl E based 0^ hlNIMU PPOPERTY 
OF FOURIEf eXPAMSIONS 

So far in our analysis no thought has been given to the 

problem of illconditioning oi the channel aatocorrelation 
T T 

matrix H H H H i said to be illcond t: oned if the ratio 

T 

of maximum ard minimum eigenvalue is large [74] When H n 

T 

is illconditioned the solution obtained oy inverting H H is 
v ly sensitive to truncation errors and noiso in the received 
vector It IS therefor'^ essential to consider numerically 
stable methocs Towards this end in this section a numeri- 
cally stable method of solving linear system of equat ons 
ba eel on minimum property of Fourier expansion due to 
/ang [58] is dopted to derive a decision feedback data 
recovery cheme 

Minimum Property of Fourier Expansion For an/ finite or 
infinite linearly independen sequence of el ments 
of a Hilbert sp^ce there always exists an orthonormal 
system ^2 such that 

= “jdlSjll 3 = 12 
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where " ^j+1 “ j+1 I t^k 1 (4 12) 

J = 1 2 


This procedure is <nown as Grain-Schrnidt orthonormalization 
Here (a p) denote inner product of a and p 


Consider an de-nent a in 
the norm 

i , -rf- 1 1 

l|a ~ 

j=l J J 


Then x 

3 


s v/hich minimize 


are knovm as the Fourier coefficien s of a They are given by 


Xj = (a 

This property s is known as the minimum property of 

Fourier exparsion 


Now let Z 2 be the m column vectors of H in 

(4 l) Since the column of H are linearly independent ortho- 
nor Tiali zing Zj_ ^2 obtain j ^2 Then 

we have the rollowing result due to V^ang [58] 


Theorem 4 1 Let r given in (4 ^ be an el ment of an n- 

diment^onal Hilb rt space x s which minimize the norm 
m 

Mr L X i l \ are given by 
0=1 


X. 


m 


(r 


ni J 


n 

(r - a 

k=m-j+l 


x.z 


k^k 


1 2 


m-1 


2 


(4 13) 
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(Proof of this theorem is not given in [58j Therefore for 
the sake of completeness we prove the theorem nn the following 
manner ) 

Proof We knoN that given r and s the c, s which ninimize 

3 J 

the norm 

m 

j|r - S c i I are given by 
J=1 ^ 

Cj = (r Yj)/IU3ll^ 


By substituting for in terms of z s using (4 12) and 

J 

grouping the terms common to s we can obtain the recursive 
equations given by (4 13) To see this consider 
ra 

S C.X-, ai^d substitute for using (4 12) This gives 

j_l j j j 


m 

£ 

J=1 





iiiTTF 


(Z3 i2>X2, ^ 


+ c„( z„ 
m'^m 



^ -m ^m~l^^m~ l^ 

1 i^m-l ^ 


From the above expression it is clear that the coefficient of 
^m Si 
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The coefficient of gives 

1 == i^-^rr^rrr Ym 1 ) / ll Yrr. ill 

The rest of the coefficien s can be similarJy obt ined 

JC 

It may be noted that in th method discus ed above is 
ootained first which is used in ootaining tjy back substi~ 

tution However for the sake o-^ uniformity we wish to obtain 
first This can be easily don by orthonornalizing the 
columrs of H starting from the mth column Le yj^ y 2 
denote the orthogonal columns ob am d this way Then the 

Governing equations of the data recovery s heme are given by 

^1 = Il)/I Wll 

^ = (r - Z x^hj^ Jik)/llyill^ (4 14) 

1 k”l 

i = 2 3 m 

where hj^ is the kth column of H i = 1 2 m are the 

es mates of the data values obtained by pa sing i = 1 
through a nonlinear decision device 

Figure 4 2 shows he data recovery sch me Proces'^ing of 
each block of data consists of m cycles tajor computational 
load IS due to the inner product coiiputabion in every cycle 


m 



FIG 4 2 Block diagram of the data recovery scheme using minimum 
property of Fourier expansion 
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Tne perfornance of the sch me can be analytically 
evaluated in th absence of error The probabilit/ of error 
associated with ith da ct symbol is jiven by (4 6) The oNR 
associat d w th the ith data symbol can be calculated as 
follows Substa Luting for r from (4 1) in 14) for v/e 
qe+ 

= (Hx H w Li)/\ IyiI 

m ^ 

= ( ^ + (w 

j “1 

Substituting for h in t rras of y; using (4 15) we see that 

"" ^1 I /ll 

Similar expressions are obtained in the ca o of other data 
symbols al o Thus 

(SNR)^ = llij.lP/lNo/2) 

i ly^j 1^ 1=12 m rhus denotes a m asure of the perfor- 

mance of the seneme anc it is related to the c annel sample 
r soonsG vector V^hen the columns of the channel convolutional 

matrix H are orthooonal jjy^l P = 1 for i = 1 2 m if 

T 2 

h^h = 1 'Vhen corr lations exist among ho columns < 1 

1=12 m This can be seen by noting that 
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m 


3"cl (hm 1 i| )yk/ll3£kll ^ 


1 2 m-1 

(4 15) 


Fron (4 15) we obtain = 1 and 


1 


m 


= 1 “ (hm-i /I l^kl f ^ ^ 

k=m~i+l m 1 K K 


4 4 DuCISlOM FtCDBACK SCHiJte BASlD ON VlODIFICD AUSTIN S 
rtPPPOACH 

On of the most vadely used DR schene n the context of 
CSDT s/ tem is the decision feedback equali or Austin [l3] 
has denv d the equations of decision feedback equalizer for 
C DT sys bens by making suitable assumptions so that detection 
theory results can be easily applied A^ a counterpart of this 
scheme in this section w derive a DF~DR schene by modifying 
Austin s assumptions In the following discussion we assume 
binary data transmission 

Let denote the symbol on which decision is to be made 
Vi/e modify Austin s assumption in the following manner for the 
case of BDT 

1 Data s /mbols are independent Gaus lan variables with zero- 
mean and unit variance for i > k 

2 are known for i < k 

3 Noi e components ar independent Gaussian variables with 
zero mean and variance Nq/2 

4 Xj^ ta<es 1 or -1 value with equal probability 
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Th 1 kelihood ratxo for Xj^ rs given by 
^ p[£/x^ Xj^=~l] 

v.her xP = (x, x^_j)T Let x,; = 

denote the future data value with resoect to Xj^ p( ) denotes 
probabili y den it/ function won can oe alternatively 
expressed as 

L •^k> P(4) ^4 lxi,=i 

'' /p(rA£ 4 ^k'> P^^k) ^4 ix^=-l 

flaking use of the a surrptions made xn the beginning of 
this s ction VC can viritc 

p(£/><^ 4 >'k> ”*'1 ®’‘pc , ><1^1 ^ 

1=1 1=1 j=l 

where K.^ is a constant and 

‘’t = k j!o ^ ^ 

^ ^ h •'l+l 1=01 m-1 (4 18) 

o g =0 '* 

Dunpong all the xactors which cancel out \ hile forming into 
we re /rite (4 16) as 
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^ tn k“l m 

p( 3 :/x 5 x,^) = Kp exp[x, b + 2 x b 2 L S x x a. _ 

^ ^ ^ ‘ i=k+l ^ ^ i=.l j=k+l ^ ^ ^ ^ 


k-“l m 

^’'k - 2='k Xj^k-j 


m m 

l=:k+l J=k+1 ^ J ^ J 


Using assumption (l) we also have 


n 

V 


m 


P(x^; = K. exp[ 2 ^ ^ 6.,] 

^ ^ i_k+l j=k-«-l ^ J 


where 6 


ij 


1 if 1 = j 

0 if 1 51^ j 


U ing the structur® of multidimensional Gaussian density fun- 
ction and following Austin we cm obtain the numerator of Lj^ 


as 


k-1 


m 


m 


k 1 


exp[x,^b,. - 2 x- S .a^+E 2 (^b -2 ^n®T-.n 

k k ^ 1=1 1 i=:k+l ^ J n-1 ^ ^ 


- Xk^j-k) ^ 

k •«i 

where q are the elements of m tri^v Qj^ = Rp. The elements of 


k-1 


"31 

R^. ar given by 


^ 2- «ij 


1 3 > k 


(4 19) 
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Thus we obtain 


k— 1 m -1 -j 

^ 1=1^^*^ n=k+l 3 =k+l 2 J 


k-1 




m 


Hov/ let gu = ” q!^- a . n = 1 2 

i=k+l "■ ^ 

3 = 1 Hi 


ra 1 (4 20) 

m 


kj k 


m 

I 

i=k+l 


and f,.. = ?a. ,. + 2 £ k = 2 3 


0=12 


m (4 21) 
k-1 


The decision ruJo in terms oi: s ard s become 


m 


3:=k+l 


k>-l 

S 

=1 


x^=l 

X j^”“l 


0 


(4 22) 


k = 1 2 


m 


Th decision rule given by (4 22) clearly reflects the 
structure of the data recov'ery schen The structure is shown 


9k n) 


in 

Fig 4 3 

in the figure 


b = 

^•^1 ^2 

^ 9k = 

^^k k+1 

^k= 

^^kl ^k2 

^k m-1^ \ 

^^k+1 





Buffer 

store 


FIG 4 3 Block diagram of the data recovery scheme 
using modified Austins approach 
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In order to lal'e dec s on regarding the I'th d ta symbol 
\i need the no/zledge of gj ^ j = k+l n and f 
j = 1 2 V -1 

Ue illustrate th for going discu sion with an example 

c amole 4 1 Consider a ) ock contaning thr data values 

X = (/^ ^2 >^3)^ transmit! d over a chann i having (h^ hj^ h2) 

a its finite impulse •^'esponse s quence Then or a received 

T 


vector r = (rj^ £2 


r^) NB have 


1 

9 9 9 

'ho " hi + h^) 

K - 2 

’"i - ir 

■h 



0 


0 




1 

®1 “ 1 

(h^hi + hihj) 

K - 2 

(rjho '■ 

^3^1 

r^h2) 

0 


0 




1 

^2 

(hoh2) 

b = 2-- 
3 1’ 

Ushc, + 

^4*^1 

=^ 0 ^ 2 ) 


The rntrices R, k = 1 2 a'f' 
1 ‘ 

®1 


^1 


^o"'' 2 


1 

‘0^2 


given d 


R2 - [^o 2^ 


Lot 




^22 


^32 

"I33 


ana 


^2 - <^33 


Then 
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923 

= "93331 


^21 

= 2311-292382 

^12 

= -(q22^1'^923^2^ 


^31 

= 2a2 

^13 

= "( 932 ^ 1 + 93332 ) 


^32 

“ 2ai 

The 

decision rul (4 22) 

becomes 



*^1 ^12^2 

Xj^=l 

0 




X, =-l 





X =1 




^2 ^ ^23^3 " ^21^1 


0 




X2=--l 





X 

0 :^ 

il 




^3 ^31^1 ” ^32^2 


0 




X3= 1 




4 1 Coiputation of the Tap Coo ficients 

ihe CO ffici<_nts i - k+1 m c n do vie/raa as the 

o coof icients of thf^* forward fa.1 er xn he cas f Xj^ ^ftore~ 
ov r these co fficient can be onlculated ef'^ici^ntly using 
Levinson-Durbin algorithm [7 ] i or that pu pose ( 20) is 
r written below in the matrix vector forn 

k k+1 


/here Cjj^ = (a 


gj^ and aj - ( aj_ ^2 
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IS the inverse of Pj^ we can write gj^ as the solutD on of 

Vi/hcre Rj^ is defined by (4 19) 

Rj^ IS a symnetric Toeplitz matrix Thereto can make 

use of Levins on-DuT'bii recur i/e algorithm given in [7] for 
obtaining gj^ s The required st ps for computing gj^ s are 
civen below 


1 

^11 


o 2^ o = 2 


2 

<^11 

= (a^ - 

i~l 

Id, a ) /e , 

^_-i i"'l J i-J i”l 

J -J- 


3 


^i-lj 

" "11 ‘^i-l 1 J ^ < d 

< i~l 





3 

4 

®1 

= (1 

x-l 


j 

^n-1 m 

= -d^j^ 



o 

^k k+i 

= 

^ 1 = 1 2 m ’ 

k = 


4 4 2 Modifiea Au tin s Approach and Nonlinear uiaussian 
limina ion I thod 

In this seer on we sho/ that the modified Austin s 
approach may be vi wed as nonlinear Gaussian elimination method 
•iith approariate edifications For hi purpose 22) may be 
written using ma rix vector no ation a 


9d 



ub ~ rx < 0 (4 23) 


where 0 is a null vector and ^ \pnotes symbolically the non- 
linear d cision de/ic llote that th riobt hand sice of (4 22) 
IS an esti late of Xj^ Therefore th right hanu side of ( ^ 23) 

1 an estDi at of ti^ data vector x That is 

Gb - Fx = Iif,x 

L t ~ ^ '■•m Th n the above equation can be wri ten as 

-1 r. 

b r X = b 

IS invertible since the diagonal elements ar nonzero) 

r 

uut b = H r/(NQ/2) which gives 

X = H^r (4 24) 

2 “T 

Conoarinj 24) vjiti (4 2) it can be seen that C r plays the 

T 2 "I ^ 

role of H li Thus w nav call G F as eff c ive autocorrela- 

tion natiix With ihis int rpr tation \ sei^ that modified 

Aus in s approach is equivalent to nonlinear Gaussian elimination 

method 
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15 SO IE OBScPV TIONS 

As we arc dealing with the problem of sol /na lin ar equa- 
ors in the presence of noise when the unknown variables take 
vi u s from a finite set it is natural to think tha availaole 
methods for sol/im linear equations must apply with approori te 
modifications Vte demonstrated this b considering four DF-DR 
sche les which are centrally eased on tl dea of nonlin ar 
Gaussian elimination method 

The two DF**DR chcmes considered in Section nd 

S ction 4 3 essentially modify already existing ne 1 o for 
solving linear equations by incoiporatin j J cision feedback as 
explained in he btg iing of the chapter Hoi;ever the methods 
discussed in o ctions 4 2 an i 1- 4 re derived based on a set of 
as unpt ons and a p-^Tfornance criterion DF DR sche re of 
S ction ^ 2 emoloys mathem tically tractabl UlSE criterion 
while in Section 4 4 v-/e used nore difficult e on eory 
approach In this approach he complexity of the scheme is 
lleviated considerably by assuming that the data value are 
indep ndent G ussian variables The major ide-rlymo assumption 
in both ihe sch m s is that the past decisio s are rro ree 

In the absence of noise all the four sch los no aouot 
provice error free perfor lance even wirhou th nonlinear 
decision device ho\/ far d c sion f edbacl nolps to inprove 
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the perforTiance ir the pres nee of noisp* can only be evaluated 
VJith the help of sinulation Although decision edback is 
an old idea [77] no us'^-ful mathenatic 1 analysis is ava-J able 
/hich deals v^ith analytical evaluation of perfornance The 
rnajo tumbling block appears o he th nonlin nr decision 
evicc \/hich d fies y analysis In Chapt r P gi /e simu-" 
la ion resuJ ts on DF OF scho les u vrlooed in vaectiors 4 3 ard 
4 4 


9a 


CHaPTi- 5 

DATA R COV^RY SClEfix-o USINb k Cl CULANT C0MPLETI0I13 

In he previous chapter we maoe use of past decisions and 

band d foeplitz natuie of xhe c lannol dUtocorrelation matrix 

H H for deriving decision f edback deconvolution schemes v^hich 

are suboptimal compared to t tL dc onvolution scheme of 

Chapter 3 It may be oos xved ha so -far in our study no 

attention has been given to the convolution matrix H of the 

channel te shall see in this chap er +hat H has some int rest- 

T 

ng propertie compnred to 1 H from the point of vxew of 
"educing computations and storag requir ments Ba ed on k- 
irculant conoletion of F we develop two data lecovery schemes 
These schemes are easily implementablc and have reduced comouta 
tional complexity ’furthermore uilike the DF DP schemes of 
Chap cer 4 which are nonlinear the DR schetos studied in this 
chapter are linear an they permit analytical evaluation of 
lor performance 

The chapt r is organiz d as follows In Section o 1 we 
1 reduce the notion of k-C rculant co oletion and describe its 
application to deconvoluti Tv o ftethods of inverting l- 
Tirculant matric s are gi /er in Section o 2 The -^iist method 
us s FFT for inv rting k-f i culant com letion of H Complexity 
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of his al'aOrithF is 0 (nlog 2 n) wh re n is chc nunber of 
rows of H Th second merhod makes use of o rsit/ nd block 
k~rirculant nature of the t'-Circvlan compl tion of d to pro- 
yiJ an 0(nlog2gj^) algorithn \;here g^^ = g 1 In S ction 5 3 
we discu s two DP schc n s which are baseo oi k~DFT Jonain 
d convolution Jiscjssed in See ion 5 1 anf^ direct inversion of 
c Circulant completion of H d scribed in c ion b 2 In 
Section 5 4 V/ obtain c/plicii e pression for probability o 
rror and compare it with the pcrfornance i DF scheme eased 
on least quare d convolution netl od 

5 1 k-CI-iCULMNT COHPLuTiOJ AID FII iTE DECOiM yOLUTION 

ronsider the received vector r given ly (2 7) 

r=Hx+w (ol) 

/hen no statistical charactc ization of x_ and w are available 
/e know that the maximum likelihood ostimat of x under the 
assunotion of r al valued daca is giv n by 

Xl = 

The rust time con uning oo ration in oib ning x^^^ is the 
in / r ion of p H Ev n ii we assume that (4^5-) is computed 

before the transmission of data memory requirements can be 
como prohibitive Therefore even vath the availabili y of 
s voral fast algorithms for inverting [78j [80] there is 
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still need or processing algori hns th + arf» easily implemen 
table In this s<=ction le consider the apolic xioi ox k 
Cnrculant matrices [81] [82] •f’or oivinc deconyoiu on pro- 

bl rn i or he sake ox sy reference so le of the results 
r garding k~v^irculant na rices are given in ppendiy D 

As an illustration vie consider (o 1'' and it 1 -Circulant 
count^roart forn=5 m=o and g = 2 In this case (o 1) 
can be written as 


* r 


h 

0 

0 ■ 



** W * 


r 

0 

0 

kho 

kh. 




* 

0 


0 





0 


0 



2 

1 


0 


0 

^1 




0 


^0 


Wi 


hi 


0 

C 

kh2 


"i 



^2 


^2 

hi 

ho 


^1 


^^2 


'^ 5 . 

hi 

ho 

0 

0 


^2 

4 - 

W2 

^3 

i 

0 

h2 

hi 


^2_ 




L 

h2 

h 


0 


0 


W3 

^4i 


• 0 

0 






0 

L 

u 

h2 

4 



0 


W4 


r=H^^+w (52) 


where Hj^ i the k-Circulant completion of 4 and is obtained 
by padding x with tA^o zeros Ix i not d3 icult to see that 
the T oresentation giv n in (5 2) in terns of H|^. is also valid 
in the genexctl case v/hen r is fini e (n = tntg) ano x is padded 

with n~n zeros to obtain x„ 

© 

From row on we call the Circulant conpletion of H as 
it IS easy to sc'^ from (5 2) that is a Circulant matrix 
Similarly vail denote the Skew Circulant completion of H 
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511 Deconvolution Usin Circulant Comoletion 

Consider the circulant completion of If P X no J 
deno e DirT ol r x and w respcctiv ly using tne prope ty of 
cyclic convolution ['^9j we can write (5 2; as 


R = h X + W (53) 

where H denote the DFT of the first column of H (H X) 
denotes poin wise multiplication of tl compon nts of the 
individual vectors Equation (5 v) suggests an easy way of 
decon olving >Mhcnever none of the component of F is too small 
or zero In su h cas'^s an estimate of x can be obtained as 

^le = F~^(n/H) (5 4) 

where F denotes the UFT matrix of orJer n and (R/H) is a 
vector obtained by componontwis division This method oi 
dccon /olution can be attributed to Cooley [83] who after 
becoming instrumental in th do/elopment of FFT algorithm [S4] 
proposed the forcg:)ing approach as an application of FFT in the 
context of signal process ng Some of the problems associated 
with such straightfor >?ara application to situat ons involving 
erroneous measuT-e nents hav been discu sed t length by Hunt[59] 

5 12 Deconvolution Using k-Circulant Copletion 

In this section we show that (5 3) and (5 4) can also be 
generalized to the cas of k-Circula'i completions For this 
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T T 

purpose let b = (b^ ^n~l^ ^ “ ^*^1 *^1 S 1^ 

be two vec ors /e define k-cyc ic convolution d and £ as 
anothe vector d given oy 


d 

1 


1 

Z b 
=n 'J 


i~j 


n-l 

+ k Z b 

j =1+1 


i-j )nodn 


(5 5) 


/e define k~DFT of b anJ c as (see Apponoix B) 
n“l 

B. = E bAXvi)'^ 1=01 n~l 

j=o ^ 


C 


ki 


n-l 

j-o 


c ( X ^ 


1=01 


n-l 


(5 6) 


(5 7) 


resoecti\ely corresponc ing inverse tran forms are 



n-l 


1=01 


n-l 


(5 8) 


= 1 =n "i„ ^ = 

3=0 

re A is an nth root of 1 
lollowing theo em 


0 1 

nd 


n-l 

■i2Ji/n 
w = e'^ ' 


(o 9) 

Now we prove the 


Theoren 5 1 If Bj and C^. represent k~DFT of b and c resp eta. 
/ ly giv n by (5 6) ino (d 7) 

, n-l 

"^1 " n % S j ^ ^ 1-0 1 n-l (5 10) 

fik = (Bj^ Cj^) 

whore *^jc IS the k~DFT of d 


(b 11) 
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Proo SuDstituting for and fron (o 8) and 

(o o) v;g ootain 

^ j=:o " t=o " s=o 


k 2 2 J ^ 2 Cj^3(Xw^ 

j 1 s = o 


n 


Sine X = k on r arr^nginj the above expres ion 

n j =o t=o s=o 


, n~l n-l n-i -,/e 

+ Is- 2 2 2 B. , C, X ^ w 

n2j=i+lt=os=o '''■ 


Oh nging the order of summation it tccomes 

, n-1 n-1 
d = 1 2 2 

PI ~o s— o 


n-1 

But 2 

3=0 


Th refore cl = ^ *^2^ <-ks( X w®)"^ i = 0 1 

s=o 


Using (5 11) we easil/ ee tnat if Hj^ 
k-DFT of h r X and w respectively then 


n-1 

k. " 

X-i 


3=0 

" n 

if 

s=t 

- 

I*' 

If 

s?^t 


\ 


(5 9) in 


i- 3 +n) 


beco nes 


n-1 


A and Wj^ represent 
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From vvhich the deconvoluti ->11 solution can be obtained as 

provided none of the component of are zeio 

513 N ed for Deconvolution by k Girculant Completion 

Note that when som of the DFT co'=>fficients of the 
channel are zero ( cannot be used for deconvolution as 

oivision oy zero is not permitted In sjch cases even if 
IS singular for some other k H mav oe invertible {1 
all the k-DFT coefficients are nonzero) Thus ir some cases 
it ma be raor advanfcag ous to use k DFT ms ead of l-DFT As 
an illustration consider a simr«l example of a channel having 
the following H matri'^ v;hen n = 4 and m = 3 


10 0 


r 

0 

0 

L 


10 0-1 

110 

oil 

Hi = 

110 0 

0 110 

»-l = 

110 0 

0 110 

1 

0 

0 

1 


0 0 11: 


0 0 11 


1 1 IS not diffi ult CO see tha \Circulant completion) is 
singular whereas the Sxew Circulant completion of H is 

nonsingular In -^act det(Hj^) for this channel is l~k There- 
fore IS nonsingular for k 7^ 1 

It may be further noted that computation of k-DFT is as 
simole as 1 -DFT co mutation by FFT To se* this consider 
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K DFT b j von by (5 6) It can bo alternatively wr_tten dS 


3 


ki 


n 1 n n 

h ( b ) w 

3=0 


vyhcre A is an nth root of < Conputation of s may be 
arried out by con^jting Fj: i of A s j = 0 1 n-1 

instead of b^ s Th s aspect na cs -DI T application more 
attractive 


5 2 DcCOnVOLUlION BY DIR CT I VZRSIO 

rh stimate or obta ned via 1 DFT and k~DFT 

gi /en by (5 4) ana (5 12) can als bt obtain d by directly 
inverting whonev r is nonsingular Th refore v\e can 
rite 


X 


ke 



(5 13) 


i/e now pre ent two met nods of inverting 
Me hod 1 

can bo expressed as (see appendix B) 

= D"^ C D 

2 H'”! 

where D is a diagon 1 matrix vith 1 a A A as the 

diagonal ntries C is a Circulant matrix with first column 
elements Dh where h is tho ci nn 1 inoulso response vector 
Therefore can b obtain d by using FT Then is gi^vefi 

by 
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= D ^ D 

\/hen n IS a power of 2 inversion ox G can be carried out 
using 2 nlog 2 n + n complex arithmetic ooerarions [82] Ther 
fore the comolexity of this method is OCnlog^n) 

Elements of the first column o are obtained a 

follows L t Cq ^n-1 first colunn Ip'me ts 

of C ^ If C* C-, C , denotes the first column elements 

o X n— X 

of then are giv n 1 / ~ C^/ X ^ i = O 1 n~l 

Method 2 

In this m thod sparse naiuie of is exploiteo to derive 
an 0(nlog2gfj^) comolexity algorithm for inv rting First 

V illustrate the method for Circulant matrices when n = igj^ 
v^htrc g-|^ = g+1 Let n = 8 and g = 3 Then th Circulant 
matrix has the following form 
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Note that hj^ iS a sparse matrix Direct application of FFT 
means comout t on of JFT of the first cPlumn having 4 zeros 
Anoth-^r mor efficient approach is to w ite as 



//hcnever Hi exists 


Hl\ 


Thus v;e obtain 


P \ + 03 = 

^1 


PB + QA = 0 

^1 

Solving the tv/o equations v/ obtain 


A+B = (P+Q)"^ and \-B = (P-q)'^ 


(5 14) 



Cleail/ P+Q IS a circulanb v/hile P-Q is a Skew Circulant Note 
that both are full matrices (no zero entries) If is a 
power of 2 \;e can invert (P-tQ) and (P-q) using 0(nlog2gTL) 


conoutations 
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No j 1 t us consider th<= general case where divides n 
s-ich thit r = rgj^ (r > 2) /e can partition in this case 


H, 


O 

O 

o 


L 


r-l 


Let exist and 


O 
/ , 


0 

0 


0 

0 

0 


A / 

1 o 




B, 


’r-l 


^r-1 


B. 


B, 


identity = 1^^ we 

obtain 

^0^0 ^l®r-l 

= Ig 
'^l 

^o®r-l‘^^l®r‘-2 

li 

O 

^o®r-2+^l®r-3 

^^1 

^0^1 

11 

C 


as 


(5 15) 
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dy adaing the abov equations we obtain 


( 8 ^ + 0 . 


o 







How consid r rth roots of unity They are 


(5 16) 


1=01 


r-1 v^here v; 


eJ2 A 


^\ultlpylng ith equation in(ul) 0<i< r*>l by and 
adding we can obtain 


(3^ + -r T (5 17) 

X 

Similarly multiplying ith equation in (b 14) by w and adding 
we get xhe general rcl tionship 


r-1 


1 = 0 


^ k = 0 1 


r-1 


(5 18) 


V(/hich contains (5 16) and (5 17) as Particular cases 


Thus in order to determine s we have to forn r k 
Circulanxs (k v;ill be different for each Circulant) whose 
inver ion can le achieved using 0(11109292) computations when 
g^ IS a powei of 2 Finally s are obtain d using (5 13) 
with 0(921092^1^ more computations Thus th'^ to al complexity 
of the f ethod is 0(nlog292^ ^ grov/s linearly v/ith n for 

fixed 92 
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-1 

Extension to the ca e of Hj^ is straightforward In this 
cas for n = v;e can write 



Since inverse of a k-C rculant is also a k~Circulant v; 
can partition as 



Thus -equation (5 14) bocomes 




^91 

\ B ,+ 

Ai B o 

= o„ 

0 r^l 



Bn "h 


= 

0 1 

1 o 

Q 1 


(5 19) 



Ill 


lov/ let X be an rth root of k Then multiplying ith equation 

in (5 19) 0 < 1 < r~l by ( and adding ve obtain 

r-1 1 

B = ( qK X w)^"^ ^ 3=012 r-l 

1 = 0 ^ 

(5 90) 

It may oe no ed that he p ocedur is s nila to the case of 
Circular t matri inversion 

5 3 data PEr'OVERY SCHEhlo 0 -wbD ON k-GIRCUL JNT COMPLETIONS 

;Vhen SIR is hijh the 1 -DFT pproach aescrib o in 
section '^12 can be used for i cov ring data Such a scheme 
IS shov;n in Figure 5 1 Although two TFT proce sois are shov;n 
in the figu'^e one is sufficient in actual practice for at a 
tine only one of them will be in use 

Note that in the case of the DP scheme show*" in Fig 5 1 
for every block of data transmitted k~DFT of the received 
vector an i an in/erse DFT i to be peT'formed One way of 
avoiding calculation of DFf for every block separ tely is to 
use the elements directly in the DR schem Such a DR 
sch m IS shown in Fig 5 2 This scheme in,/olves a circula- 
ting hift register of lenr-th n in v/hich fir t row elements 
or are stored and circulated The tai coefficj nts of the 

cyclic transversal filter are the received observations 
1 ^ ^n-l multiplier with coefficient k in the 

feedback loop of the circulating niter dep nds upon the cotr^le 
tion used 
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Hk 

FIG 5 1 Block diagram of the data recovery scheme 
using k“DFT 



FIG 5 2 Data recovery scheme based on k-Circulant 
completion 
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Processing of each data block consists of m cycles If 
the entire processing is completed in nT seconds v^hexe T is 
the symbol duration th-^re will be no need for long buffers to 
store the incoming blocks In this case the delay involved 
Afili oe one block dux tion Thus two registers of length n axe 
sufficient One is used in the processing whil the other one 
stores observations arriving due to tho next block 

The complexity of the DP scheme shown in Fig 5 1 depends 
on the method used for implementing FFT Since FFT algorithm 
IS parallel and recursive it is suitable for those real time 
applications where cost of the DR schemo is nore important than 
the probability of error performance 

ma 3 or advantage of the DR scheme shown in Fig 5 2 is 
that in its implementation complex arithmetic is totally 
a /Old d Moreover its implementation is simple compared to 
DR schemes considered in the previous chapters 

h 4 PERFORA/uMCE CONSIDERATIONS 

In the context of data transmission it has generally 
o en observed that the complexity of DR schemes seem to be 
Girectly proportional to the desired performance If vel Thus 
minimum probability of error (the best perfo-rmance) demands 
hiQhly complex DR schemes Therefor we may inrcr that DR 
schemes based or k-^Circulart comcle ion being less complex 
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tie T perfornance nay not be satisfactory compared to DP 
ch nes of chapt rs 3 and 4 Hov/ever th*=‘ DP sch mes con- 
sidered in this chuoter have d distinct advantage over DR 
schen s c veloped in th prev ous chapters when the S IR is 
high In this section we obtain explicit expressions for 
che probability of error and comoare it with the performance 
0 DR scheme based on least square deconvolu ion Simulation 
studies on the performance of the DP schenes tudied in this 
chapter are presented in Chaoter 8 

To begin with let k = 1 Substituting for r fro-n (5 1) 
in (51 ) we obtain for k = 1 



+ w 


(5 ?1) 


From (5 21) we s e that the effective noj se variance defends 
on th elements of Since rhe elements in any row is a 

cyclically shifted ver ion of the first row and since noise 


components are statistically independent and re of equal 
variances the effective variance is given by = ^2*^1 
where 



n 

S 

1=1 



(5 22) 


and hj^ is the first column of V/ith th knoi^ledge of the 

2 

DFT coeffici nts of h we can exor ss dj^ alternatively as 
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where ^2’ *"> components of H or the eigen- 

values of H-j^ . The following theorem provides a lov-.'er bound 
on dj^ . 

2 

Theorem 5.2 j as defined by (5.22) is lower bounded by 


T'T' 

n( E hi) 
i=l ^ 


Proof : 


I'Ve know that for a nonsingular matrix A of order n 


which implies I!aa'’^H^= ijlllg or jjl|jg< llAjlg 

(5.25) 

where j |a| denotes the Euclidean norm of the matrix A given 
by 

9 go" 

Now let A = H, j then j JHt j j = n 2 h^^ (5.26) 

i i=l 


^li ^ 

of we have 


... n denote 


iHf I 


1 ] |2 
e 


n 


= n 2 h": 


0 


i=l 


li 


the elements in the first column 


(5,27) 
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Using (5 25) (5 26) and (5 27) v obtain 


0^0 9 o 

n < n^( 2 hf 1 , hf) or 

1=:J_ 1=1 ^ 


n 

2 

1=1 




Using (5 22) in the above inequality vve obtain (5 24) 

V 

{5 22) and (5 2A) are also valid in ihe case of k Circulant 
completion since |kj =1 Therefore we can write 



n 

2 

1=1 




9 0 

n( 2 ht) 
1=1 ^ 


(5 28) 


It IS interesting to note that all the data symbols recovered 
have the same probability o being in error because SNR asso- 
ciated with each of them is sane It is given by 


(SNP)i = 


1=01 


m-1 (5 29) 


When jk| =1 The probability of error (PER) is given by 


/ 


1 2 
1 “ 2“ y 

e dy 

.f2ii 


Q(‘ 


'■(No/ 2 ) 


) (5 30) 


V(No/ 2 ) 


PER = 
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Let us now consider th probability of rror performance of 
the DR scheme based on LS— deconvolution solution given by 
(5 2) In this case Si4R associated with data symbols will be 
different The average orobaoility o error is given by 


m 


PEP 


Lo 


m 


2 Q( f -o- 


1=1 


d? N 
Li o 


(5 31) 


,2 ^0 


vdiere ^ is the variance of the loise compon-an associated 
with ith data symbol /n pper bound for PERj ^2 obtained 

as 




2 

d M 
max o 


) 


(5 32) 


where = max df 

max Li 

1 < 1 < m 


2 

We note that d» is the squared sum of the elements of the ith 

Li X 

T ’—IT 

row of (H H) H Equivalently they are the diagonal elements 
of (H^H)“^ (because (H^H)"^ h'^H(H^H)“^ = (H^H)'*^) Vde now 
show that 

d^ > d^^ 1=12 m (5 33) 


IS a particular case of a more general result Let 

H = [h H 1 where Hq is the souare completion of H such that 
g c-* ^ 

M IS invertible (Suen conpletions are treated in greater 
<3 

d tail in Chapter 6) 
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L6t d 1 1 2 n be the diagonal eleTnents of 

(H^ H )'^ In the following theorem prov nat 

^gx ^ ^Lx (5 34) 

11 is ©asy io see that (5 33) follows as a special case of 
(5 34) when |kl = 1 


iheorem 5 3 Given dj^^ as defined above 

1 2 V j\2. ^ . 

‘‘gi '^Li 1 = 1^ m 

*T' 1 

Proof (H^ written as 

g y 


‘«g «g> ' 


T T 

H H 


He H He 


‘11 

*^12 

'21 

*^2 


oince 



We have 

^11 ^^^c^21 “ -‘•m 

^12 ’’’ ^ ^c^22 “ ^mxn-m 

Therefore from (5 *^6) w obtain 
hTh^ = 


(5 35) 
(5 36) 
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— 1 T 

v;her^ exists becau e F H is a posiiive definite matrix 

^ 2 . 0 a 


T 

substituting for H rl in ( 35) w get 

V/ 


g g 




^11 '' ^ 12 ^ 22^21 


(5 37) 


u 


21 


r 


a H F IS a symn trie matrix 
iz 9 y 


-1 

No\; let be the diagonal ^1 ments or ^^2^22^21 


Since = G ^2 ^22 ^ P ^ 


^12^22^21 ^ ^ definition oi a p d matrix A 


X > 0 for all 5 e s” xcept x = o 


which snows that 6"^ is strictly positive Now using (5 37) 


d? =d2 

Li gi 




v^here 


gi 


dZ. are the diagonal entries of Gj^j^ 




oummarizing in this chapter we have s udied the applica- 
tion of k Circulant completions for data reco / r/ in the con- 
text of BDT tie hdve analysed two DR schemes v^hich facilitate 
good reduction in omputational complex t/ and torage require- 
nents compared to the DR schemes studied in the previous 
chapter Horeovor these schemes are am nable to oerformance 
analysis U have obtainec explicit expressions for the proba- 
bility of rror and cornpar d it with th p rfornanc achievabl by 
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DR scheme based on LS-decor ^;olutlon In general the perfor- 
mance of DR schemes based on k Circulant completions is infe- 
rior to the DR schemes of chapters 3 and 4 However in 
Chapter 8 we shall see that in the case of some channels 
DR schemes based on k-Circulant conpl tion perform well 
compared to ML-DR and DF-uP schemes 

In the next chapter w take up a decaileo study of the 
relationship betv/een least squares deconvolution and deconvo- 
lution via k-Circulant conpletions 
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But = 3 




1 -1 

1 2 


Ther fore 



1 lo 

-1 23 



X 


1 


Thus it becomes impo tant and interesting to know condi- 
tions under wh cl ~ Ic ^ caus in su r a case LS solu- 

tion can be obtaine 1 van nuch less cornpuxation via k Circulant 
completions 


In the present chapx r we study chis problem in a more 
g n ral framework of square completion of rectangular matrices 
Let Hg = [H Hg^] be nonsingular square completion of H 
in gen lal need not depend on H Tie k Circulant comole- 
tion of H IS a oarticular case of wh re depends on H 

Our interest is to obtain conditions under- 

which 


Let = 


X 


LS 


X 

s 



(6 3) 


T 

ie how that x. = x if and only if - 0 , Such 

-”Lo si mxn-m 

completions are called or hogonal co ipletions As a corro- 
llary it follows that x, == Xi, iff , = 0 Under 

this condition we fur h r show that orthogonal k-Circulant 
completions of H are orbhogonal k Circul nt matrices 
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Wf organize the chapter in the folloving manner In 
Section 61a method of solving overdeterr in d set of linear 
equations using the notion of squar conpletior of natricos is 
discussed A ‘^riof review of least squares solution of lin ar 
system of equations and Moor -Penrose (/IP) inverse of matric s 
IS given in Section 6 2 In oection 6 3 jc obtain condi+ions 
on squar completions that result in P-inv rse or least 
squares inverse (LS-inverse) of a full ank rectangular matrix 
Sauar completions which result in MP-in/erse are called ortho 
gonal square completions V further sho y that is an ortho- 
goml k Circulant completion of H iff is an orthogonal k- 
Circulant In Section 6 4 we determine channels which are 
amenable to LS solution via k-Circulant completions \/e show 
that in most of the practir 1 cases LS solution to the deconvo- 
lution problem cannot be obta ned via (6 2) because in such 
cases k-Circulant completions do not result in orthogonal k- 
Circulants In Section 6 j vye characteriz orxhogonal k- 
Circulants in the k-DFT oomain An altcrnat expre sion for 
LS solution using partitions of k-Circulant comoletions of H 
IS obtained in Section 6 6 for the purpo e of knowing the 
relaxionship between Hj ^2 >iP— invor of H /o show that 

h" = «k2 - Hk2 <Hk3 Hk3)~^ '^k3 


wher H is the Moore-PenTos inverse of H 
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6 1 SQJoRfc completion A^^ID SOLUTION OF LIM EQUATIO J 

s the doconvolution problem is assent ally solving a s t 
of linear eguations we first consioei aiplicotion of square 
comol tions for solvina a system of linear equa+ ons giv^n by 


AX = b 


(6 5) 


where A is an nxm matrix with n > m Let i nk of A(>r( a)) be m 
Let Ag = [a => nonsingular souare conplction of A 

Such a choice of A^^ possibl b cause A is a full rank 
na rix Lot x be in ext nded vector 

mr- 


y 

G 



(6 6 ) 


ifh r o IS an n-m length zc o v ctor In t rms of A~^ we can 
ob am a solution to (o 5) given by 


X 


e 



(6 7) 


Note that 9 ncral \/e vail return this ooint 

later Now let 






(6 8 ) 


whoT-e IS a solution o {6 j) /ith rospcct to hu comole- 
t on AgjL Depending on th c oic of A oifr lent solutions 
arc obtained natuial cuesx on th d -nands answer at this 
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stage is ;heth r all such solu 3 ons ar equivalent in so e 

sense or nox Because if th solution given by (6 6) i 

ind p ndent of A , it nay oe economical in terns of computa- 

tions to choos \ . sucn tha inversion of in/olves least 

si s 

ornputationol complexi y One snple resul in this connect on 
IS th folloving 

Theorem 5 1 If ^ belongs to th range space of \ then 'x 
giv n by (6 7) is indeoend nc of 

Proof L t -ni-i columns of A Since b 

IS in the range space of A b = 

some s Therefore solution to (,6 ) is given by 

^ n = ■£ 


L t A be any nonsingular square conplotion of / 
® ■ A. “• 


Let 


-1 

s 


A 


's2 

s3 


Then from (6 8) we see that 
b = 


's2 




Since we obrain A-oA = I„ 'fherefore = £ 

s s n s m —1 — 

which IS indeoendent of i ^ 

Note that the condition on b demanded by Theorem 5 1 
cannot be guaranteed in practic i b does not belong to 

the range space of \ /e consider this case in S ction o 3 
In th next section wo give a brief reviev; of the conventional 
methods available for d aling with this case 
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6 2 lE/'ST square mi 111 Ui OLUTIOr JU f GORE P^mOSE 

Gu^EP SEIZED IinIVEPiSE 

ihe rretPOvj of solution normally used v/? ep b is not in the 
ra je sp ce of a is to constrain the solution space The 
m thod of 1 ast quares is one v/^/ay of constraning the solution 
p ce Je choose only those y s v/hich minimize 

j I X b| (^ = ( X b)^ ( Ax - b) (6 9) 

when A is of rank m it can be shown that the right hand side 
of ( 69 ) IS minimized by 

A^b 

when does not hav full rank (r(A; < the method used is 
to further constrain the solution space b/ considering )c s 
hich minimi z (6 9) and have minimum length It can be shoyvn 
the such a solution is unique and is given b> [85] [87] 



where -C*’ is called the \Aoore~Pcnrose (IIP) invers of ^[85 3 
s tisfies the following properti s 


1 


= -A 

2 

+ + 

A AA 

11 

3 

VA •") 

= aa'^ 

4 

( I'^A)" 



(6 10 ) 
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LS L& 

A matrix A which satisfies the conoitions ^ = A and 

T C TO 

(AA^ ) = AA IS called a least squ re inve se of [O J 

LS + 

When \ IS of full rank it can be shovm that A = A 
3 L /oT SQUr^PES SOLUTIO'J \/I SQU/R CO IPLETIU S 


Another approach that can be taken v/hen b is not in the 
range space of is to e tend the solution space It is easy 
to s G that squ i completion is a w y of extending the solu- 
tion space The solution obtained by forming Ag^b depends on 
;hich controls the solution space In such situations it 
is in t uctive to know \ ^at kind oi corioletions lead to I'^a t 


squares olution Alt natixely we are int re ted in A. i s 

'-\,1 

a lea t squares inver or 


which ma! o ^^2 ^3 


-1 


2 

s3 


loore-Ponrose inverse Th following lemma characterizes MP 
inverse of A via square completions 




Lemma 6 1 Let A^ = [A A 

Jt- 

IS the MP inverse of a i-^f (Agj^Ag 3 } = gi^s 3 


's2 

'a3 


Then A 


s2 


Proof h know that A^^A^ = A^A*”^ - I„ Therefor in terms 

s s s s n 

of the partitions of A and th following matrix equations 

s s 


must be satisfied 


s2 ~ 

s2 sl~ ^mxn-n 

^ "0 
s3 n-mxm 

s ^sl” 

^■^s2 


(6 lla) 
(6 lib) 
(6 11c) 
(6 lid) 
(6 lie) 
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Jsing (6 11a) it is easy to shov; t satis igs the first 
three properties of he r P-inverse of a given b/ (6 10) The 
ou'^th proo rty in ( 6 10) requires t lat 

^ ^ s2 

From (6 lie) we ca » so that this condition will b satisfied 
^ si s3^ "" si 3 

■ 3 (* 

Using L mna 6 1 we can prove the follov/ing tieorei 

Th orem 6 2 Gi /on a nonsingular comol loi of ^ 

1 ^s2 

~ [ ^ 3 iJ and it inverse s ~ s2 ^ ‘ ^ 

invors of iff L 

Pioof Let Ag 2 1 1 P inv rse of \ Then = (A^A)”^A^ 

T 

ubstitutirg for m (<- llt>) wc see that P A^, = „ 

^^ 52 '' si m/n-m 

This oroves the first part of the theorem 

Now assume that A^A^i = ^ Let (X) denote the 

si mxn-m 

r nge pace of P Then R( A) -L R(Agj^) Here X indicates that 

k(A^j^) is orthogonal to R(a) From (6 lib) we have 

f{ A^^) JL H(Agj^) Since P(Agj^)x T(A) it follovs that the rows 

of pans R(A) But columns of a also sp n P(a) So 

T 

-\g 2 “ da tor some nonsinjular matrix D Subs t tuting for A 2 
in (6 IJ 1 ) we get D = fha implies A ^2 ~ (A^A)”^ ^ 

From now onv;ara we shall r fer to square completions 
having th property A ss orthogonal completions 


129 


In th neyi th orem <; consider the impli olior o Theorem 6 1 
in the ca e of k-Circulant completions 


eorcTi 6 3 Liv n a nonsinqular k-Circulant coipletion of H 

'H, 


^ 1 ^ ~ [H inverse = 


\2 


Vl 


k3 


i j 2 the IP- 


in/ rse of H iff i an orthogonal k-Oirculant i atrix 


Proof From tho oefinition o k-Circulant matrix (Appendix B) 
V c 11 that h-^ th irst colinn of Hj is related to oth r 
columns or Hj^ through //hich is a k Circulant raitrix with 
first ro/ (00 k) n othcrwords 

1 = 2 3 n (o 12) 

wh rc h^ IS th ith colon i of Fj^ 

Using Theor m fc> 2 know that Hj ^2 ^ 'the MP inverse of H 

If h’^h. , = ^ 

kl nxn~m 

For this condition xo hold ve must hav 

hjh^ = 0 j=12 m i = n+l n 

(6 13) 

In view of (6 12) (o 13) molies 

i)! = 0 J = 1 2 m 

1 = m+1 n 
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T 2 

But \ppenoi B) 

Ih^^refore we obtain = O 

o- ~ ^ 1=12 n~l 

Bu "O^hj^ IS the ixith coiunn of Hj^ 

Iherefor in this case is an orthogonal ic-Circulant 

* 

Fron the forogo ng di cu sion it is clear that the 
square completion of rectangular matric s provide a general 
framework for the stuJy o deconvolution problems Both 
the 1 ast squares approach anc th m thod based on k~Circulant 
complet on are particular ca cs with appropriate choice o the 
completions In the light of Theorem 6 J in the next section 
m d termne those channels which admit LS solution via k~ 
Circulant completions 

6 4 CH/-JVJNELS M-lt lABLE TO Lo SOLUTION VI k CIRCULANT 
COMPLETIONS 

In this section we are interest d in determining those 
channel convolution matrices 4 such that is an orthogonal 
k-Circulant Two cas s are to be considored 

Case 1 m > g 

In the case of block data transmission m > g This is 
n cessary oecause otherwise xeduction in th erfective data 
rate o/cr th channel will be 1 rg Thu form of in this 
case is shown below 
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\ 


h. 


0 

h, 


0 


kh 

c 

0 

0 


kh 


0 1 


kh. 


u 


0 


h. 


h. 


o 

hi 


khi 

kh2 



0 


0 


‘g 


’g~l 


2 


^1 


I IS eas/ to see that for to be n orthogonal k-Circulant 
the following equations are to be sati fied 


= 0 


Since 


h 


k ( h^h;^+h^h2+ 
o we obtain 




= 0 


= 0 


This means that the only channel that admits LS solution via 
k-CircuLant completion is the distortionless channel having 
h^ 7 !^ 0 and all oth^r ISI components zero 
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/ now consid x the case n > m+g This case axis s in 

most of the deconvolution applications For instance vhen 
TFT IS to be used for inverting H It is oesirable to hav n 
a poA/er of 2 in such situations Therefore wh r n is not 
a power of 4. the channel vec l-or is pa ded with zeros Another 
motivation for consid ring this case is that ere nay exist 
some n > m+g such th t LS solution is obtained via £<-Circulant 
completion 


In this case H. 3 11 ha /e a more general form as shown 


b low 


»ke = 


H H 


VA 


H 


ko 


v/here 0 is a null matrix of order n m-gxm Using the arguments 
given earlier we can easily show that is an orthogonal k 
Circular t only when h^ 7*^ 0 and h^ = 0i=12 g 


Case 2 m < g 


This situation arises in convolution si uations where 
the number of unknowns is less than the number of impulse res- 
ponse coefficients 

In this case takes the folioring form when g = 4 and 


m = 2 
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Ho 

0 

kh^ 

khg 

kh2 

khj^ 


Hi 

Ho 

0 

kh 

khs 

kh2 


hi 

Hi 

Ho 

0 

kh^ 

kh3 

Hk = 

H3 

H2 

h 

0 

Ho 

0 

kh4 


H4 

H3 

H2 


Ho 

0 


L ° 

H4 

H3 

H2 

Hi 

h 

0 

For Hj 

to be 

an 

orthogonal 

k-Circul 

kh^ 

h + 

) 

H2H0 

+ hg 

hi 

V'2 

= 0 

kh ho + 

0 o 

khj^h 

4 + ^3 

h + 

th 

= 0 

kh^h^ + 

kh^h 

2''"*^H2 

h 

0 

H3H4 

= c 


nus'f' I'avc 


Any solution to the oovc set of ec nations s rves as 
th« de ired channel Thus for m < g we e +hit it raa / be 
possible to obtain LS solution via k-Ci-^ ul nt completion 
Explicit form of h^ s is difficult o obt in n Lhis case 
in the n xt section we give n ait rnative characterization 
of orthogonal k Circulani /hich helps ii obtaining some 
insigit into th natu o ox the possiole solutions 

6 5 CHAPACTERIZATiON OF ORTHOGO\AL k CIRCUL^WTS 


From Appendix b we have 


Hk = Fj^^ di g ( ^-Q 


-1 




■ J 


(6 14 ) 
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and = FD v/here D = diag(l p 
Using these in 

= In 

we obtain 


A AFj, = Ij, 


or 

D F'^A'^”"'^ D ^ D ^F 

A FD == 


where 

A = diag( 

^n-i^ 


Noting 

that F = we 

obtain 



A F (DD^)'"^F ^ 

A F = D* 

(6 16) 

or 

a’'f(dd'^)''^f’"^ a 

= F{DD*)“^F* 


Let 

X = F(DD*)"'^F'‘^ 


(6 17) 

Then 

a'^x a = / 


(6 18) 


The oroblem of determining orthogonal k Circulant thus reouces 
to he detern^nation of A such that (6 18) is sa+isfi d for 
the given k none of th elements of / are zero uue to the 

diagonal nnture of A it is asy o see that s iiust satisfy 
th condi ion 

[Xq ] 

= C (matrix of all ones) 

(6 19) 


fK 


^n-1 



To see this n = 2 Th-^n will be of the form 


X = 


ihen l\ -^ (\ = 


X 


X 


11 

12 

21 

X 22 

^11 

X^X 

^ X 
1^21 

2 ^ 


In order to satisfy (6 38) ve must have 


= 1 ^2 ~ ^ ^2 ~ ^ 


The procedure for obtaining an ortho jon 1 k-Circulant is as 
follows lor the given v lue of V (6 18) rru t be solveo to 
obtain s which in turn proouce via ^6 14) ks an 
llustration we con icier he case when I = 1 

\Jhen k = 1 (DD’^)"'^ becomes an identity matrix Hence 


X = 


1 

0 

0 

0 


O 

O 

0 

1 


0 

0 

0 

0 


0 

1 

1 o 
o 


U ing (6 18) wo s e tha ^ i ® hogonal circulant 

satisfy 


2 
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For a real matrxx w have 

\ =’"*-1+2 1=2 3 n with 

Therefore 

I n , , 

9 + 1 ir n as even 
*^ 2 “ n IS odd 

Different choices for ^ 2 ^ i different orthogonal 

real circulants Thus v/e have infinit numb r of orthogonal 
Circulants The s are given by 

= cos0^ + j sin0^ O ^ 0-j^ < 2 % 

For instance when n = 4 we can have 

A^=:l ^ 2=1 A^ = cos0 + jsinQ 

Then the first row of the desired k~Circulant is given by 

h^ = (l+cosO sinG l~cos0 sin9) 

6 6 LS SOLUTION USING k-CIRCULANT COMPLETION 

From the analysis in the previous sections ve conclude 
that for most cases of practical interest LS solution to the 
decon solution problem cannot be obtained via k-Circulant comple- 
tions as given by (6 1) Hovever although he solution given 
by (6 1) IS not the LS solution it may be very lose to the LS 
solution In this secxion v;p obtain an alternate expression for 
the LS solution using k-Circulant completions 
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Consider the received vector r given b/ 

r = Hx + V/ (6 20) 


We first obtain the LS solution using heuristic arguments If 
// w re to be a zero vector and exists for some k we can 
obtain exact solution to (6 20) as 


X 


Xi = Hj^2 



(6 21 ) 


wher 

= [H 



On the otherhand vjhen vtf is not a zero vector we have in 
general 2i2 ^ ^ ^ ^2 

2-2 = + w) But Therefore 

Hk3 i = Hk3 (6 22) 

The n nimun no m 1 ast square solution {6 22) is given by 

« = Hi.3(Hk3 H*3)“1 H ^3 r (6 23) 

Thus we have estimated the noise vector w in the best possible 
manner under th given conditions Ve can use this estimate 
to reduce the n feet of noise in (6 20) Substituting for r 
using (6 20) in (6 2l) for Xj^ we obtain 


Xi - H|^ r = X + H^2 JS 


Using (6 aS) fox w we get 


Hy2 r = X + Hj^ 2 ^k3*'^k3 ^13^ *^k3 - 

or X = H^2tl - 4jHk3 ^ 


Ic novf claim that no b ttcr result can be achieved under th 
given conditions A forrral proof of lus claim is given 
b low 

T1 orera 6 4 = ^k2l^^"%3^^k ^kJ ^ 

Proof ie show that (6 24) sat sfies 11 the four propertie 
of tne MP-inverse given by (6 10'' Using (6 11) whe e ms ead 
of we have and H| ^ replace vath 

Hk 2 = As 2 and = Ag 3 it is e^sy to show thar -representation 
of f’*' given by (6 24) satisfies th followinf-* condit ons 

= H 

and = h'''H 

“4" _| 

'/e hav to finally shovi that (HH ) - HH For this we make 

use of (6 lle)which gives after appropriate subst tutions 


^^k2 ^kl“k3 " 


Therefore ^ 


k3’ 



1 9 


- ^ kS^ ~ ■’i i^^kS '' l^k3 

= [i-Hk. (h^ 3 Hka)'^ t'ks] 


vjl'ich IS a syt If trie matri 

i he re fore (HH"*") =5 

But such a matrix is uni ^ue [B5] 

■3t'^ 

In Ihc foregoing qiscu ion /e u ed heuristic arguments 
for obtaining (6 24) -Jov; we will show that (6 24) can b 
derived in a more foria’' manner Fo“" this purpose we v/rite 
{<' 20) usinc k-Ci culant completion of H and extended vector x^ 

clS 

r = Xg w (o 2 ^) 


jote that Xg is an extended version of x oot m d by 
padding x with zeros However while s eking solution to 
(6 5) via we ignoreo this constraint on x^ Th rofore 

the solution naturally differs fro a Xj^g xceot in some 
special cases This means that in oroer to obtain LS solution 
to (6 25) we must minimize 


(£ - X,) (r - H;, kj 


(6 26) 


subject to the constraint 


0 x ^=0 

G 


(6 27) 


Wh -e C = Ig] 
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This nini nization problem can be solved usin^ Lc^range 
mul ipli r m hod Lot a = the mtitipliers 

Tnen c fo m 


r(x a) = x^) (r~Hj^ x^) + C x 

Different ating F(x a) / th rospcct to x and a we obtain 
conditions for mini lum as 

Hk Hfe 2.0 I a = 0 


aid C x^ = 0 

e 

AS IS invertible we obtain 


and a 

existence of 


= r - ul a 

= (C H* ^ C^)“^ C r 

C^)~^ follows by noting that 

= Hj ^3 where = 


»k2 

»k3 


and Hj ^3 is a full rank matrix Thus 

ie = S - (Hk3 ^^kS " 

Therefore the solution to tne original problem is given by 


X = H,.„ r - H^2 Hk3 ^«k3 


‘k2 ^ 


*k3 
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U mg Th or m 6 4 we sgq that x is the LS solution to th 
deconvolution problem 

Using (6 24) ve obtain an xpression for the di-^ er nc 
AH = - F given by 

AH = ^ o (6 28) 

Note that Ah 3s ind pendent of Therefore it c n be 

computed b) kno/ing 

If the 1 ments o F ar''" small the solutions obtained 

4 * 

using hj ^2 will noc uiffcr s giificantly I *» th case 

of orthogonal k~Circu] nt completions of H it is easy to see 
that ah = as F^^ I = ^mxn-rn 

In summary wf* hav stuoi d LS U c nvolution problem in 
the framov/ork of squar conpletion of rectangular matrices 
We have shovm that in lost of the oractic 1 situations LS 
solution cannot be obtuinea via dir ct inv rsion of k 
Circulant comoletion of the chann 1 convolution matrix 

Another method of ootaining LS solution is by using 
it xative schemes In the next chapter we study steepest 
descent algoiithn in th discrete Fourier transform donain 
which provides LS solution Lo the dcconiolu ion problem 
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CH/OPTER 7 

L SqUAR^o DhCONVOLUTION ~ I rcRATIV- APPROACH 

In thp previou chapter we considered th pos ibility of 
applying computat onally attractive k~Circulant comoletions of 
ti ch nnel matri H for obtaining L solution to the de onvo- 
lu ion p oolern which involves inversion of H H Our analvsis 
sho /ed that in most of the practical ases the solution given 
by ^6 l) using 1-Circulant comoletions di not yield the IS 
solution to the decon /olution problem %n alternate expression 
for L solution v/as also obca-ne J in S ction 6 6 Though th 
de“'ivation of this expression mak s use of k~Circulant comple- 
tions the final expr ssion is not computa lonally attractive 

T 

compared to the urect in/ersion of H H 

In this chapter we study ano her metho i of ootaining LS 
solution to the aeconvolution problem It is based on the 
application of wellknown steepest descent algorithm (SDA) [89] 
which IS an iterative technique in contrast to the noniterative 
or cirect approach consideied in Chapter 5 

Gersho [24] appears to have used ixed step SDA for the 
first tim for the purpos of adaptive chai i«l eou lizati on in 
v^hich the tap oefficients o-^ the equalizer are adgusted conti- 
nuously so that the mean square error between the actual and 
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stimated data syabols is minimized He has shovm th^t in the 
or sence of noise the algorithm yields a suboptin 1 setting of 
the tap coeffici nts 

\ialzinan ano Schvjartz [21] [2_] have stuoied fixed step 
oU/j in the DFT dom in for the ou pose of a tom ti channel 
eoualization Usii two examoies they ha/e obser/ed ti at th 
DFT domain SD*l conv rge faster than the sample domain SDA as 
exact I nowledg of tt eigonvalu are avail ole in th case of 

DFi Goraain SDA Ti^ir work has be n extended by Picchi and 

Prati who hav inciud d self orthogonal zing feature into 

the JFT doi 3n 1 ration scheme Using simulation studies th v 
have shown tha the per ornance o self-orthogonalizing DFT 
domain qualizafcion scheme is sup r or to that of the sample 
domain algorithm cu to Godard [dSJ 

The observations mad oy /alznan and Sch\;artz [21] and 
Picchi and Prati [64] ar more carefully ex nineo in this 
chapter One re son for this is based on o \r und rstanding 
that UFT b ing an orthonormal transfornacioi th it ra ive 
sch Ties in both the domains must have same convergence proper- 
ties But th-^re i ay be co iputatj onal advantages in going rom 
sanplo domain to th DFT o Tiain du'^ to th availability of fast 
algorithms for computing DFT 

l/e devot a lajor portion of this chapter towards a b tt«-r 
understanding of tho “'olo of DFT and k-Circulant completions in 
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reducing processing tin ano orovi^ing last converg nc Our 
naly is clearly shows how DFT helps in redaciny conputa ions 
Jsing rh fr me ;orI o I~Circulart comolctions u sho\i that 
dvant go in t T' or f ster converg nc r t can be chi v q 
in the DFT domain b caj it p o/ides n th c sc o some 
xanples Dood stifraxo of the con /erg ic ara r ter it i 
horn th t th estimate obtained using k-Circulart c nolction 
can also be used in tho sample oon in to obtain s me conv r- 
g nc ra 0 

"^h Chao ter is orgcOiz J in the following mann r A on f 
r VI •! of steepest d cent aljorilhn is given in oection 7 1 
Ihc a nne n v/hich DFf helps in r ducino computat ons is dis- 
cuss d in S ction 7 2 In oection 7 3 we oon /«■ SuA in th 

DFT doinain from thro f i nt v\ v/points oat recover/ 

scheno basoo on DFT dome n bDi is iv n in oc ction 7 3 1 
Converg nee oropertics of SDA r discuss d m Sc tion 7 4 
method of increasing the onvero nee rate of the SD is dis 
cus d n S<=>ction 7 5 fe show ho / Girculant ar k-Circulan 
comoip ions c n be uscct to r due nunbei or itor tions This 
analysi orovides xpic.nition for the f st convergence beha- 
vior o he self-orthogcnalizinc DFi dtonaan scheme sxudied by 
Picchi ana p-'ati [64] In cti 7 6 vie shov; ho stimat s 
of step length in the cas f iix a t«p can be obtained 
using cigenv lues of th k-Circulan completions This explains 
the observation mad by i l^nan nd Schvarez: [21] reqc»rding 
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fa t conv rgencG of DFT domain schen-^ conpd Gci to sample domain 
sc r e 

1 OF STulPEcsT DE'dCi-i\'" LGORITBi 

in this s ction w oiscuss briefly c rtain g neral f atures 
of he /;ellknown Cau hy s steep st d see it Jgorithn [89] Con- 
sid r th qu drati obj ctiv f nc+ion giv n by (2 3) 

F(x) = xWhx - 2x’^i'^r - "r (7 1) 

The SD constructs c. sequenc of v ctors starting \ ith 
chos n a bitranl/ given by 

^1+1 = ^1 Hx^) 1 > 0 (7 2) 

;h r IS det rmined such that is ninimizcd Substitu- 

ting (7 2) in (7 i) and diif rentiating \i r to it can bo 
shov,/n that is given o/ 

Tel 

= >4-^ e, = n'^Cr - HxJ (7 3) 

Comoutation of at ev ry iteration 3 s tho most time con 
sun ng part of SD/* Thcr foro in nost of th practical applica- 
+ion 1 fix d at a value a chosen such th t th optimum 

speed of c nverg nee is achieved It can b shown [S9j that the 
iteration scheme (7 2) conv rgos to th LS solution 

x^S = r 
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I may be int rest nj to note it t the fixeo step SDA 
(cj ~ 0 )T all i) 3s essentially a j neralized version oi the 
Jacobi iteration [74] for solvino the linear e nation 

T iteratiin scheme in this cas ta es he fo r 
^ 1+1 = ^1 '■ 


This iteration scheme can oe shovn to converge f 
0 < a < 2/X^ fh oo 1 lum value o a is jiv'=>n by 

iUq X 


a 



2 

+ X 

lax nin 


(7 5^ 


where and X„. „ the maximum and ninimum eigenvalues 

nnsiX nin 

T 

of respectively [90] (see page 24) 

7 2 APPLICATlOn OF DFT TO STEEPEST DESCE T ALGOPITHIv\ 

V now consider the possibility of using DrT to reduce 
computational load associated with SD4 Consider e^ given by 

= H^(r - Hx^) 


Let be the Circul nt comoletion of H and x^^ be the extenaed 
vector formed by padding x^ with n~m zero Then w can write 


where 




= hJ (r Hj^ (7 6) 

2il = '■Il<£-h>‘:LO> = tH HJ 


L 


e 


il 
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From (7 6) it is clear that if v\fe compute the ri ht hand 
s de of (7 6) IS obtained as he firsfc n ntries of 

jow let denoi the DbT of In ern of the DFT of r x 

and h the first coluiin of nq can v;rite (7 o) in th DM 
uo nain as 


= I-, ( I H, 


le' 


(7 7) 


nr fore by knov>/inq P anc ^ the r h hand side of 

(7 7) IS easily comouteJ and is then obt ined as 

= Pf\ (7 8) 


wher P I 

Now if n denotes th DFT of e ^ where e is an exten- 
—le *~ie le 

ded vector obtained by padding with (n~n^ z ros a given by 

i X 

(7 3) can be written as 


a 

1 







(7 9) 


fh IS by knowing the Dbf of e^^ computation of becomes 
relativel / simole task as v;e al-"eady have the kno A/ledge of 


It shoulo bp noted that the value of remains same both 
n the sample domain ana th DFl dor am Accordingly the 
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convergence rate renains unaltered b/ the application of DFT 
We v^/ill com back to this point later 

Further we v/ish to note that ns k~DFT computation using 
rri algorithm requires more conputation oniarad to DFT k~ 
Cl" ulant completions othf i than k = 1 arc not as useful in 
reducing computations per it ration conpar d to Circulant 
completion 

7 3 DbKiV TIOii OF THc DFT DO lAlN STECPfcST DloCENT ALGORITR^ 


In this section /o derive oDA in the DFT domain from thr e 
diff rent viewpoints The obj ct vo is to cl arly bring out 
th role of DFT in Sua 


Approach 1 Using the extended vector % and Ci culant comple- 
tion of H v/o can write (7 2) al ornativel/ as 


== X + a P He (r - n,x, 
—(i+lje i'^' 1 1 l—ie' 


where 


n-nxn 


(7 10) 


Premultiplying tho above equation bv th DFT matrix we 
obtain 

wheie A - Fx Since F F = we can modify the above 
le le n 


expression as 
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T «• 

ilow FHj^F and are diagonal m trices vith u’^T of th 

first column of and its complex conju ate a diagonal 
elements respectively Th refore v/e can v/rit (7 11) s 

"^(1+1)6 = ''le SFP fI (e-bl ^^le) (7 12 ) 

Moreover we can write (7 12) also as 



(7 13) 

(7 14; 


(7 15) 


The pair (7 13) and (7 lo) repre ents D T domain i ration 
schem s corresponding to (7 2'' anc (7 4) respectively 

^Vpproach 2 In Approach 1 v; deriveo DFT domain SDA, starting 
from sample domain oDA In the pre ent approach ue formulate 
the decoivolution o oblem as 
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mxn (r 
zeR^ 


(,£ ■“ Hz) 


subject to Cz = 0 


(7 16) 


where C 


[0 


n~nxm 




(7 17) 


The minimization problem given by (7 16) involves synme- 
xnc Circulant positive semidefinite matrix in general It 

T T 

mav noted that eventhough H t is oositive definite 

need not alwa/s be so \ sirpl il^ustrativ xample is giv n 

belo\i 


Consider 



o 


r 1 

H - 

-1 1 

cl-^arly = 

2 

1 



-1 

2 


^ 0 -1 


L J 


positive definite 


wh rtas the Cir-culant cotnoletion of H 



1 

0 

-1 


2 

-1 

-1 ' 

Hi 

~1 

I 

0 

gives H^hj^ = 

-1 

2 

-i 


0 

-1 

1 . 


-1 

1 

2 


T 

which has 0 as an eigenvalue Consequently is positive 

semidefinite 


It may be furth r noted that whereas nini ization of F(x) 
gi /en by (7 l) is an uncons trained probien (7 16) defines a 
cons 'rained minimiza lon p oblom Sich problems can be solved 
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using Rosen approach of projecting the gram nt at every 

iteration on to the null space of C [89j [91] L t G b a 

natrix such that CG = ^ From \7 17) i is easy to 

tl at f' can have the following form 

“ 

m 

G = - - 

m 

Following the approach given in [89] (see pages 260 2 66 j 
M can write aown the iteration scheme for (7 16) as 

wher = min but QG = P i/e can now use DFT 

dn>-. write (7 18) as done in th cas of y^pproach 1 in the 
DFT domain Thus we obtain 

1 ' 4 ^ r - ij* i^) (7 19) 

Since plays the same role as in 13) we s ^ that 
(7 13) and (7 18) aie identical 

Approach 3 W now consider the approach taken by Valztnan and 
Schwartz [21] and Picchi ano Prati [t)4] for deriving DFT domain 
SDA Using F and the Circ ilant cjmpl tion of 1 we can rev^rite 
th minimization problem given by (7 16) as 

min (Fr FHj^^) FF (Fr FH^i) 
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* 


writing - rHj^F Fj; and noting that Fb 


min 

Yec" 




(R-rij^ Y) 


v;e obtain 
n 


(7 20) 


wh re by our earlier convention r = Fr 1 = Fy 

No ^ in terms of Y e we can fo^-iulat the mini iization pioblem 
given by (7 16) o uivalently as 


min 

yed^ 


(P-H^ Y) 




(R -h 


O 


(7 21) 


subject to 1) F Y 1 real vector 


ana 2) CF / = 0 


wh re C is same as in (7 16) solution to he above problem 
car be obtained using Rosen s gradient projec ion method as 
de cribed in [21] Alternatively since (7 21) is d rived 
using (7 16) vhich has (7 19) as the corresoondu g SDA in the 
OFT domain it follows that (7 21) a'' so v/ill have (7 19) as 
Its corresponding oDrv in the DFT domain 

At this stage we v;ish to note the follow nr distinctive 
feature of the three approaches niproach 1 f eals with a 
unconstrained minimi z;ation proilen In Approach 2 we deal with 
a constrained mimmixntion problem with one constraint In the 
third approach we have to deal with tvo constrainrs Thp- form 
of SD/ in the DbT domain hov/ever remains unchangea Likewise 
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Ve convergence oarameter also re lains unchang d by he 
apolication of DFT Thus we can conclude ha DFT and th 
associated Circulant co ipl tion I elp only in reducing the 
comoutational comol xity of th iterativ scheme These 
asoec ts donot b cone clear ir the SDA i d rived using 
Aporoach 3 alone because solution of the rinimization probl n 
given by (7 21) do s not sh w explicitly its relationship 
with oDA in th ample Jomain 

7 3 1 Data R. covery Schen based on SDa in th DFT Domain 

A DR sche le basso on DFT domain iter tion sch m (7 13) 

IS sch natically sho m in ’"igu-e 7 1 In this scheme the 
staiting ooint s chosen as 

^oe = filHl 

I'lote ttat in the absence of noise and when the Cir ulant 
completion of 3s nonsingular repres rts DFT of the 
actual data vector padded with n-m zeros Therefor'^ in such 
situations the iteration scheme w 11 converge in one itciation 
On the otherhand when noise is piesent provides a good 
starting point oc he iteration s hem The p rfor Jance of 
this scheme will o sane as that of DR sch ne based on LS 


solution 


FFT 
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FIG 7 1 Data recovery scheme based on DFT 
domain steepest descent algorithm 
















7 4 RAlE of CONV HGENCE OF SDA 


oDA gener tes an infinite sequence of s whose limi is 
the solution to the optimzation problen Due to vere con- 
straints on processing tim in a comnuni cation situation large 
number of iteration will not be a desirable feature Therefore 
1 b come important to know the speed of convergence of SDA 
In this connection we have the following tneorem [89] 

Theorem 7 1 Suppose that x is the solution to minimization 
of FCjc") given by (7 l) L t c^ be the condition number of 
That IS Then (see [89] pag 146) 

F(=£n.l) - F(^) < (^r)^ [F(Xl) - F(x)] 

From Theorem 7 1 it is clear that SDA has line r rate of 
conv rgence The rate of convergence depends on th condition 
number of the channel autocorrelation matrix If = 1 the 
iteration scheme onverges in one iteration But as in- 
cr ases tne convergence rate decreases and hence large number 
jf iterations will bo needed oefor mcaningiul estimate of the 
solution vector is obtained Thus SD is not an efficient 
method when the condi+ion number of tic c lannel is large One 
mothoa ox ccv„lerating the convergence rat of SDA is by 


altering the eigenvalues of the channel autocorrelation matrix 
so that condition number is near to unity In tn nox section 
V consider this aspect 

7 5 FAST CONVERGING STcEPl-ST DESCcNT ALrORITHM 

Consid r th it ration scheme given by (7 2) The self ic 
conv igcs to the exact solution when 

H^(r = 0 (7 22) 

for some i Thi means hat in tcao or c ^ wo can substitute 
aq wher Q is a nonsingular matrix and obtain another- itera- 
tion scheme 


•^i-fl " - Hx^) (7 23^ 

v/hich will also give tho san^ solution as (7 2) p-^ovided a Q 
and H satisry the n cessary conv rgent conditions )c can 
how that the iteration scheme (7 23) converg s if 

I jljjj - aQH^HlI < 1 

or 0 < a < 2/ X „ where X is the ma> imum eigenvalue of 

rnsX niaA 

QH^H 

If Q = It IS easy to see th^t the ito ation 

scheme (7 23) converges to the s lution in one iteration if we 
choose a = 2/(X where X is the minimum eigen- 

value of QH^H (\;hon Q = (H^H) 


157 


It IS clear f om the above discussion that different 
choices of Q will lead to different iteration schemes For 
W " v/e obtain fixed step SOA Since corrputat on of the 
best choice for Q which is (H^H) ^ itself is uneconomical 
Ae must choose <4 such that it is a good estimator of 
or the inverse of the channel autocorrelation matrix buch 

choices are difficult to ob am in th samole domain 

Now let us look at the DFT domain representation of 
(7 23) given by 

= 4 . (’ 24 ) 

where as before y, ^ = F^£, and E, ^ is aiven by (7 14) 
vj-j^ IS now an nxn matrix ’'rom (7 2^) we observe that if 
FQj^F is a diagonal matrix additional computation needed for 
multiplying 1 and ^ is just n multiplications Therefore 

in order to make FQ^^F diagonal must be a circulant matrix 
Since the best choice for Q is it seems natural to 

choose for Qj^ (H^H^)*"^ whenever is nonsingular This 
feature has been exDloit'^'d by Picchi and Prati [64] in their 
f \st converging self orrhogonalizing DFT domain equalization 
scheme in the context of channel equalization 

So far in this se tion we discussed the application of 
Circulant completion for obtaining good estimates of the 
convergence parameter However it may not be always possible 
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to obtain good estimate of the conv rgenco parameter /ath 
Circulant completion In such cases k-Circulant completions 
can be js d For this pu-pose let assum 

that 1 invertible When lk| = 1 it can be shown ttat 
Qj^ IS also a k Circulant Therefore making use of k-DFT 
(7 24) can b written using k Circulant completion of H a 



■^(i+l) ke 

= 4ke 

where 

4 c. 


and 

4ke 

= 


.~lr 


E u = Hu (P.“Hu X 


-1 

Since Qj^ is a k-Circulant matrix Fk'^k^k ^ dia- 

gonal matrix It may b noted that use of k~Cir ulant comple- 
tion r quires computation of k-DFT v;hich can le computed u ing 
FFT algorithm as described in Chapter 5 Th efficiency of the 

iteration scheme depends on tte value of k u co n oirect 
nalysis of th eigenvalue behaviour of Qj^ and consequently its 
effect on a is difficult as it depends upon the channel given 
This aspect needs mor investigation 

7 6 FIXED STEP ST'^hPEST DESCE H ALGORI fHNi 


Th DFT domain version of fixed stco SDA follows from our 
discu S 3 on in Section 7 3 In th s case we can write (7 13) as 


-(i+l)e 


= X 


-IG 


aC 

-le 


(7 25) 


159 


The b St choice of c is qiven by (7 5) as comout t on 
^max ^tnin ® difficult task stinces of th igon- 

vail s of the channel autocorrelation matrix can be used \n 
alternative method would be to choose the eigenvalues of 
or hJHj^ if th y are good estimate ox the eigervalaes of 
One reason for such a choice is Hat they can b onputed 
easily using DFT /ialzman ano Schvarxz [ 1] havp used eigen- 
values of in the iterative schene Fo\ e /er th y do not 

seem to have noted that a obtained using can also be used 

in the sample domain 

Let jf and be maximum and minimin igenvalues 

of and let 


a 


(k) 


X , + X , 
max k nin k 


(7 26) 


I k) 

If a IS c-ose to a th degradation in the convergence rate 
0 th iterative scheme v/ill not be appreciable Towards this 
end /e prove the following theorem 


Theorem 7 2 Let X „ ana X_, „ b^ the naximum and minimum 

max min 

T 

eigenvalues of H H ihen s 

^min s - Nnin 


where X and X represent maximum and minimum eigen- 

max s ' min s 

values of where H is a nonsingular square completion of H 

s s s 
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Proof Wc first prove that ||h^h|| < | |h^H Ij 

3 S 

where { j | | is the spectral norm of a matrix Let P 
bo an nxn matrix Using P wo can write 

ihtill = IIph^h^pII 

li = IIh^'hiI 


for IIph^h^pII = II 


0 

0 0 


Thorefore < ||p||2 I | 


A P IS a proj ction operator it has eigenvalue ith-^r 0 or i 

Therefore | |h*^h1 | < | | 

s s 

If ^ ana arc the maximum einenvalues of 

Uia/^ S lUQA S o 

T 

and H H respectively we obtain 
max max s 


That prov s the first inequality in 


W rov; show that '^11 1 


\<ie have 

s s 


h’^h. 




h’^h. 


h’^h. 


(7 27) 


Kobe that = [H Consider 

s ^ c 


G 


-(hIh)(h'^h) 


T,a-1 


the matrix G 

o" 

( r 

I 

_ 
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Then 


l|(j ^jj = 1 Therefore 


ll(^K)"hl = ^li ||G-hl 

Using the result ||ab|1 < |j^|j }|^|| v/e obtain 

ii(HV)“hi > ii(hX) ^ '■ii 


= li(GHt j"hi 


'low GH H = 
s s 


T 

h‘h 


T 

F H. 


0 

C C C C 


Therefore | ( | > 

^ o 

Therefore | ) | | < ||(hJh 

S 5 


Therefore ^ 

min s ■“ mir 

T* 

where ^ and are the tniniirum eigenvalues of 


and H H respectively 


V-K- 


In particular for k-Circulant conipletions we have 


^max k - ^max 

and (7 28) 

min k '^min 

In a aiven situation for fixing « it may be desirable to 
try out different k~Circulant completions and choose the one 
which proviies maximum a But this involves additional compu- 
tations The problem of maximizing a over all possible 
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k“Circulant completions foi a given channel does not appear to 
admit mathematically tractable solutions Thi as ect bovever 
needs further investigation 

In summary we have discussed the role o DFT and k- 
Circulart completions in reducing tie comput tiunal complexity 
and increasing th convergence rate of SDA have shov/ed 

how to obtain better estimates of the convergence parameter 
a using eigen /alues of k-Circulart compl tions of channel 
convolution matrix H As there is a one-to one correspond nee 
between sample domain and DFT domain iteration chemes esti- 
mates of a obtained via k-Circulant completion can be used in 
the sample domain itself to orov de faster convergence 

SDA has only linear converg nee property and tho rate of 
convergence deoends upon the condition number of the channel 
autocorrelation matrix In this connection eif orthogonali- 
zing scheme discussed in Section 7 5 could be useful 

Considering the drawbacks of SDA despite its several 
advantages it appears that when there is severe constraint on 
procos ing time a better method v/ill have to be chosen Th 
method so chosen must converge fast and it must have a better 
rate of convergence Vte wish to note th^t conjugate gradient 
algorithm (CGA) [89] meets thes d mands Howev r it is com 
putationally unattractive because each iteration takes more 
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processing tim compared to SDA Koba/ashi [92] has consi- 
dered CGA for adaptive channel equalization h cr CGA 
docs not app ais to have received much att ntion in the ar a f 
adaptive channel equalization du to its conput tional 
complexity 


CHAPTEP 


O 


1^4 


PERrO MANGE OF DATA REGOVE Y SCHE Lo 

In this chapter v/e give a comp ra^i/e ac oun of oerfor- 
man e of some of the da+a r cover/ schemes tudied in previous 
hapters Perfornance is sjecified in tern o p obabilit/ of 
error (Pe) Sine the pr b bilit> of er ^ oeoends uoon block 
length channel parameters at reco/er/ s hene enplo/cd noise 
statistics and the rate of tran mission over h chann 1 except 
in very special cas s in general it is very diificult to 
obtain close form expressions fo Pe In thi cor nection it 
may be recalled that it as possible to obtain clos form expre- 
ssion for Pe for DR scheme oa iJer d in Chaot r 5 On the 
other hand th schemes consio red in fhaot rs ano 4 are non- 
lin ar in nature and hence are ai ficult to Under 

such situations simulation studies help ir evaluating the 
performance of the Dp sch me erployed Th oughout thi chapter 
we assume binary data transmission Ho ;evcr th analysis can 
also be xt ndod to multil vel du.+a 

This chanter is organ zod in tho following nann r As a 
prelud to the study of th perforroan of various DR schemes 
in Section 8 1 wre charact riio aood c annels for 3DT which 
introduce tsi and provide good performance subject to a given 


1 6 -j 


crit non There nre t i/o re sons or krojing u h channels 
Firstly they provide a benchmark for comparing h perfor 
m nc of other channels condly on coula u o or f It r 
at the transmitter o as to make the ov rail r soonso of the 
channel ncl th p-^efiltcr o resemble do ely a good ch nnei 
Channel examoles used in th simulntion stud/ are giv n in 
S ction 8 2 In S ction 8 3 w scuss oerformanco of BDT 
sy t ns i sing o •^formance curv s for a w a range of clock 

1 ng+hs and tyoical chann 1 oxanplcs In S ction 8 4 v;c study 

tho effect of increasing lol aroig th nombc'»'s f a block 

v/hich haop rs when the dat rate ov r the ch nn 1 is to be k pt 

the same as source dnt rate 

8 1 GOOD GHAivINELS FOR BLOuK DATA TRAIL lISoIOi 

811 laximum Minimum Distanc Cnonneis 

L t S be the set of all possible m"! noth d ta vectors 
We know from our discussion in Sec ion 2 4 ••'hot vhen r is 
received in the pros nc'^ ox /hite Oaussian noise the best 
estimate of the transmitt d vector x is given by a vector 
Xji^ e such that 

I U Hx 111 lir-Hx^ll for all x^ e (8 1) 


xi 


I 


L t Sy. denote anoth r set dofin q as 


(8 2 ) 


//hex Vj IS the received vector 
noise 1 absent Let denote 
distinct vectors / and y Then 


co'f'responding to /hen 
I’he distance t tween tv/o 


“j.:, = Itj. - ijll 1 / j 


(3 3) 


Du to the presence of noise the deconvolution rule (8 1) 
need not result in which i the actaal d ta vector trans- 
mitted In ord r to minim e the o currcnc of such situations 
it IS d sirable to have good s paration b t/ n any pair of s 

V/ 

in terms of the distance metric given by (8 3) Let the minimum 
distance be 

Vn = Illi-Stjli (8 4) 

^1 ^ 

/ithout loss of gen rality v/e will consider channel res- 
pons s with unit length A g+1 length vector f is called maxi- 
mum minimum distance { J^AD) channel sample response if 


^ = ram d 
min ij 


1 < 1 3 1 2 


m 


(8 5 ) 


subject to f = 1 and -1 < < 1 0 < i < g is maxiraum 

The Gcond onstraint in the above formulation is nece- 
ssary + o avoid trivial solutions for example f^ = 1 and ^ 
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d in (8 3) can be written as 

J 

Since conv^olution op ration is coninatativ \i can int r- 
chang the rol s of and h and write 

<3 = (/,-x,) f ( O 

wh re 0 1 ^ 1 7 

and IS the convolution matrix with in he first column 
I t 


it then follow's that the elcm nts of arc ernary 

vanabl s (+2 0 ~2) Moreover ^ is also a onvolution matrix 

^ J 

2 

We can now write d^^ alternatively as 

d?-, = Q-,t I 

wh re IS a symmetric Toeplitz matrix is given by 

^ij “ ^ij ^ij 

In terms of (8 8) the optimization problem (3 5) o com s 

max min (S 9) 

f E 

l<i<2‘^ 

subject to 1) f^f = 1 
and 2) -1 < < 1 0 < i i g 


(8 10 ) 
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Th following lemma provid s -naximum value achi v blc if 
v/e solv (8 9) subject to (8 10) 

Lemma 8 1 In the case of binary alphabet the maximum d 

min 

achievable is at most 2 
p oof Ite make use of the inequ lity 


min ij 




(8 11 ) 


whore ij ^nax ij minimum and maximum eigen- 

values of 

Consider two data vectors which differ in only one posi- 
tion In this case Q is a diagonal m trix with all diagonal 

^ J 

entri s equal to 4 Therefore 


X = X 

run ij max ij 


(8 12 ) 


Using the condition f^^ = 1 in (8 11) we get 


X 

min ij 


< < 


max ij 


(8 13) 


From (8 12) and (8 13) it is clear that w cannot find an f 
for all 1 j such that 


f^Q^jf > 4 for all 1 J 


Using Lemma 8 1 ai prove th fol owing theorem 
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Theorem 8 1 Determination of f which aives d - ? is 

"" ^ min 

equivalent to solving 

> 4 for all i 7^ j and K <4 ( 14^ 

min ij ' 

fj-f = 1 


-1 < < 1 0 < 1 < g 


Proof 

X 

min ij 


If f IS chosen s tch that 
< ^ we have 


for all of those with 


T 

f. 2 clearly for the res of the s 

f ^Qi f > 4 holds from ( 13) 

According to Theorem 8 1 the proc aure for obtaining 

channels is to first determine all those Q. s for which 

J 

^min ij ^ have to solve the set 0^ dra’f'ic 

inequalities given by (8 14) While good amount of literature 
IS available on linear inequalit es [93] very little seems to 
have been acnieved in understanding of systems of quadratic 
inequalities We will not solve this problem directly in this 
thesis Instead wo will consiQcr another characterization of 
good chann Is called maximum distance chann Is (MD~channels) 

/e shal3 see lator that MD~chann 1 haracterization is helpful 
in obtaining tUD channels 
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8 12 naximum Distanc Channels 

We no ; onsider those ch nnel v/hich maximize ^he sum of 
dis met distances between all possible pairs of elements in 
Sy That 1 If tl e pairs a-^cJ give the sam« 

distance = d^^) only one of the pairs will be considered 

in the suiination In this ense the problem ma/ be formulated 
as 


max Z T 

a+1 f Q f 

f eR9+l Q distinct” J” 

J 

subject to (8 10) 

put differently (8 15) can also be written as 

max Q f 

f e 


(8 xo) 


(8 16) 


subject to (8 10) where Q = 2 q (8 17) 

1 j 

distinct 

In the presence of the second condition in (8 iO) the 
problem given by (8 16) is difficult to analy e te therefore 
solve the following simpler problem 

max Q f (8 18) 

f e r9+i 

subject to f’^f = 1 

A solution to problem (8 18) can be obtained by using 
(8 11) from which it follows that the eigenvector corresponding 
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to the maximum eigenvalues is the desireo oljtion to (8 18} 

If this solution satisfies the second constr int in (8 10) then 
a solution to (8 16) is obtained provioed th nininum distance 
achieved is 2 in the binary case Hovjever Y proc dure out- 

lined above is computationally unattractiv for large block 
sizes r^oreover it has not been oo siblo to oot in conditions 
under which solution to (8 18) is also a solution to (3 16) 

We feel that a more rigorous study Jiay lead to interesting 
result In the absence of such r suits v/e have follov/od the 
procedure outlined below for obtaining ID as /ell as MD 
channels 

8 13 Procedure for Obtaining WiD and ID Channels 

1 Given the block length m and number of ISI samples g 
form the Q matrix given by (8 17) 

2 Determine the normaliz d eigenvectors and the correspond 
ing eigenvalues of q 

3 The eigenvector corresponding to the maximum eigen- 
value is a solution to (8 IB) 

4 Compute the minimum distance for eacn eigenvector satis- 
fying the second constraint in (8 10) 

5 The eigenvector giving maximum ninimum distance a 
solution to (S 14) if the naximum minimum distance is 
2 in the binary case 
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It must be noted that ;e may not g t solution to (J 14) 
as given by the last step in all the cases To /ards this nd 
NB conducted sone nanerical experiments to ootain channel 
r ponses using the above procedur for s ver 1 values of n 
and g Sorre of th s" results are pr sented in Table 8 1 In 
the last column of the table v;e have given the mininum dis- 
tances achieved In all th" cases ; h ^e obtained both IAl\D 
as well as MD channels Another int restin feature is that 
son of the channel responses are reniniscent of the 
p rtial response channels [94] For instance in the case of 
two ISI terms the channel responses ( 707 0 707) and 

(- 707 0 - 707) are duobinary channel responses The channels 
obtained for g = 4 5 6 also sho/; similar features 

The foregoing observation is interesting because partial 
response signalling schemes were or ginally sujgested in order 
to achieve better spectral shaping of the transmitted signal 
As we do not have yet a formal definition of such schemes it 
IS difficult to establish meaningful relation between spectral 
shaping and maximum distance separation This aspect needs 
further inv stigation ‘\t this ooint we wish to note that 
Folconor and Magoe [47] also have shown that optimum desired 
impulse of th channel and prefiltcr combination of leng h 
two under minimum mean square crit non must b the duobinary 
xmpulsG response 


Table 8 1 Some examples of iD and jMD Channels 




Q 

D 

D 




<n 

T3 

X3 'O 





C 

c c 




U 


m 




CT3 






B 

CD 

cC 

a Q 

g o g Q 

n Q 
^ - 

a 

3° 

9 ^ 

^ 9 




00 

CO 


c 



CO 

0 

H 

H 



vjO 

Vy 

t 

O 

o\ OJ 

Csl <N CM <N 

CM rH CJ 

CM 'H 

04 H 






O 






or 






CO 






CM 






O 






O 






O 




lO 

OO 





iD CO 

CM t- 

OO 

vO 0 




00 0- 


<X) 




Q in 


00 O 





00 1> 

CM 




o 

o r- 





o 

^ tn 

O O 

<D 






iO 



o 

o o 

O 

C 



o o 


O 

o 



o 



a 



o o 

OO 

O O 

10 






<D 


oooo 

lO 

OO 

O 

U 


r- C-- 

in CO 


vO 



o o 

CM O 


cu 

XJ 


1 

CO h* 0- 

00 t-* 

CO o 

<D 

r- 


o in 

at> 

CM 

rH 

OQ 

o 


^ tO 

o 

Q 

h- r- 

o o o o 

o _ 


o 

pj 


C- h- 

o o 

OO 


rO 

o o 

1 



to 

<0 1 


o o 


o 




Q 

OO 

o 

rH . 

: OO 

o o r~- 

o 


o 

<D 

1 

1 

o o 

o 

OO 


c ! 

OO 

O o r- 

o 


o 

C, ; 



in i> 


CO 

m 


> 1 

lO CO 

lO 

QO 

x: ■ 


r^ 

vo r- 

vo r- 

vO 

o ; 

o o 

o o 

rH 

rH 

vO 

r- h- 

r- 1 - o o 

CO in o 

00 in 

00 in 


1 

o o 

o o o 

OO 

1 

0 o 

1 


CO 


in 

vD 

r- 

e 

vO 

vO 

vO 

vD 

r- 


173 


174 


fHD channels with = 2 have another interesting 

property when used in conjunction with L-d convolution or 
Vitorbi algorithm For such channels there will bo essentially 
no loss in SNR when ML-dc convolution m thod is adopted This 
conclusion is based on the analysis given by Forney [38] H 
has shown that in the cas of naximun lik lihood sequence 
estimation the symbol error probabilit/ is bound d by 

Kl Vn/No) < Po < Ku Q( Vn/"o) (8 W) 

where 

CO / 

q(x) = / e“"Y dy (8 20) 

Y275 X 

and and Ky are constants independent of noise variance and 
the channel parameters is typically v^ithin an order of 

magnitude of V/e kno\/ that for one shot transmission (no 

ISI) the probability of error is given by 

Pe(one shot) = Q(2||f[(/No) (8 21) 

Thus if - 2||f|| the probability of error achieved in the 

presence of ISI using ML-*deconvolution procedure will be appro- 
ximately equal to Pe (one shot) 

8 14 Computation of Minimum Distance of a Channel 

A direct method of d ternining is to compute the 

distanc between all possible pairs of jr s belonging to set Sy 
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given by (8 2) This is a Jifficilt job even fox noderatp 

block lengths We now show that l^L-PDA d v 1 6 x \ Chapter 3 

can be modified for conpiting d 

^ nin 

pT' m our oarlicr discussion in this chapt r it is clear 
that the problem of finding ninimum distai o cun be formulated 


as 


min 

^ "j " 




L t z = X “X 
-ij -1 J 

Clements of ar^. tornary variables taking vnlues from 
tho set { -2 0 2} Let z denote a v tor whoso cl m nts are 
ternary variables In terms of g the above probl r can be 
alternately formulated as 


min zVh z (8 22 ) 

z 

subject to z^z > 0 (8 23) 

T 

Note that the constraint z z > 0 is ncces ary to eliminate 
all zero solution for cas s corr spending to 

The foregoing problem is a quadratic optimization problem 
in the presence of a constraint In order to find the non- 
zero minimum value wo adopt the procedure of Chapter 3 with th*' 
following difference In the fir t step v^ien z^ is optimized 
for Gv ry given value of Z 2 Z 3 ^g +1 ^^^ose only non zero 
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2 ^ s Re t of the recursion stage are c rried out wi lout any 
constraint This follows from the fact that s nee Zj^ is con- 
strained to take only nonzero /alues the constraint (8 23) is 
satisfied and hence rest of xhe s can be hosen arbitrarily 
vVe wish to note that in the context of CSDT Burkhart and 
Barbosa [95] have sugges ed a modified Vit<=>rbi alaorithm for 
determining the minimum dis ance of a gi/en hannel 

8 2 CHAI^N^LS used IN THE STUDY 

In order to compare the performance of diff rent data 
recovery schemes it is necessary to consider channels \;hich 
show both merats as well as dements of various DR schemes 
The channel examoles considered are given in Table 82 In 
laole 8 2 the first two channels A1 and A2 are maximum dis- 
tortion channels considered oy Austin [13] The next two 

Table 8 2 Chann is used in the simulation s Jd/ 


rhannel sampled response ‘^min 




Al 

3“^/^(l 1 1) 


1 

633 

A2 

1 1 

1 1) 

1 

265 

Cl 

2'"1/2(- 235 

667 1 667 - 235) 

1 

933 

C2 

2“ 1/2^ 235 

667 1 667 235) 

1 

188 

Pi 

( 227 460 

688 460 227) 

1 

131 

P2 

( 407 815 

407) 

1 

630 
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exanple<5 Cl and C2 taken from [4] Th 1 st tv;o exa les 
Pi and P2 are taken from [7] 

Maximum distortion channels as the name it elf indicates 
exhibit maximum realizable disto tion according to some distor- 
tion measure Austin [13] determined such channels b/ choosing 
the samples of the channel autocorrelation co ffici nts 
aC-g) a(0) a(g) so as to maximize 

£ |a(i)| 

i=-g 

subject to 1 a(0) is unity 

g 

and 2 A{w) = E a{i) oxp “jiw) 

i=-g 

g 

1+2 S a(i) cos(iw) > 0 
1=1 

when w e (0 75) 

The second condition implies hat the channel is realiza- 
ble Austin has shown that the sampled auto orrelation fun- 
ction having a triangular envelope corresoonds to maximum 
distortion channels in the sense defined above 

8 3 SIMULATION STUDIES ON DATA R COVER\ SCRfcUES 

The following data recov ry schemes are considered 

1 ML data recovery scheme for CSDT if LC 

2 ML data recovery scheme for BDT MLB 
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3 Decision feedba k scheme for CSDT DFC 

4 Modified Austin s appioach for BDT hA3 

5 Fourier expansion method with decision 

reedback pgg 

6 LS daxa recov ry scheme for BDT LSB 

7 Circulant completion ba oc, cher e for BDT CCB 

8 Skev; Circulant compietin bas d ch me for 

BDT oCB 


Note that a three letter idontiiier is associ t d vjith each 
data recovery schere ihese identifi rs have been used through 
out in the text tables and figures Wo vash to note that LSB 
IS based on Fourier expansion method vathout decision f edback 
In all the simulations 10000 data s/mools taking binary (-^1 1) 

values were used The curves plotted arc obtained using single 
simulatioi 

In Figures 8 1 - 8 9 w have shown the va'»'iation of th 
probability of error with SNR for the six channels given in 
Table 8 2 Performance curves in th case of MLC are obtained 
Using ^U,-RDA given in Section 3 2 vath the following 

modification D cision regarding a transmitted data is made 
after a fixed no of recursions say ID That is aft r the IDth 
stage we follow the path corresponding to the maximum value of 
the objective value achieved so for nd chooso the data value 
oxresponding to first stage After that wo shift the ID stage 
results ono stage baCiC so that the second stage now becomes the 
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Fig 8 2 Comparison of performance of various OR schemes 
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110 8 8 Comparison of performance of various DR scheme* 





^8 9 Comparison of performance of various DR schemes 
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first stage The procedure is continued till all the trans- 
mitted data are decided The value of ID i m it oied in the 
figures The decision feedback scheme for C DT (DFC) is based 
on the eauations given in [?] The number or for\;ard taps used 
is den ted by ^T in the figures For Ih ake of co pan on error 
probability curve for channels vath no ISI is Iso shovm in 
the figures 

The Figures a 1 to "^9 cover a sufficiently wide rang or 
block lengths and channel responses The figures indicate that 
the performance of MLB is better than MLC \jhcn ID is equal to 
the block length In the course of the simulation studies we 
have observed tbat ior obtaining good performance at medium and 
large S’MR values ID must be large in the case of PLC In 
Figure 8 10 we have compared the performance of MLB and /ILC on 
th ma'<imum distortion channel (1 1 1 1 1) Figure 8 10 shows 
that ILC performance saturates if ID is not la g 

From the Figur s 8 1 - 8 9 we also observe that MAB performs 
well compared to DFC when the block length is equal to the numb'^r 
of forwaid taps However it must be kept in mind that MAB 
requir s more memory conpar d to DFC It may b recalled that 
the computational complexity of borh he schemes are more or 
less same FEB how ver does not p rform as //ell as MAB One 
reason is that FlB assumes no knowledge of the noise variance 
One attractive feature of FEB is that it can handle illconditio— 
ned channels more efficiently compared to the Trench algorithm 
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based MAB in v-hich illconditioneo ch nnels can j /p r se to 
lai'Qfe values of the tap coefficien s 

It IS interesting to note that in the case of 01 (see 
Table 8 2) there is essentiaJly no differ nc oeti/een fALC 
and MLB for block length of 8 12 16 In fac CC perfornance 
is also very close to MLB One reason for t is perhaps is 
that for this channel is i 93 Whereas for the other 

channels it i much less than 2 (see Table 8 2) m order to 
check the validity of this claim, in Figure 8 11 we have 
plotted the performance curves fo the example given in [33] 

For this channel is 2 Performance curves indicate that 

the loss in performance due to CCB compared to vlLB is not 
ignificant This observation however needs more inv stiga- 
tion 

Figure 8 12 shows the effect of block length on the per- 
formance of CCB and SOB in the case of channels Cl and PI 
Although the performance in the case of channel Cl *53) 

IS better compared to that with Pi = 1 13") the perfox 

mancG depends strongly on block 1 ngth 

831 The Effect of Increased ISI Amono the Block Elements 

So far we have considered BDT in which the efroctive data 
rate over the channel is less than the source data rate due to 
g zeros following each block rf now consider the situation in 
which the data values of a block are transmitt d at a higher 




FIG 8 11 MMD Channel performance 
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FIG 8 12 Effect of m on the performance of CCB and SCB 
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rate so that there is no reduction in th d. a r t ovPr the 
channel However +hi£ results in increased lol among th^ 
block members The effect of incr asing the data rato on the 
performance is the topic of this section 

First we consider maxmum distortion channels Xn 
Figure 8 13 we have shown the effect of increasing ISl ;hcn 
MLB IS employed For the sate of comparison /e have also 
plotted MLC performance for ID equal to the bloci length Note 
that the mLC curve for ID - 16 aturates aft 14 dB 

Figure 8 14 shows the perforn ncc curves in the ca e f 
DFC and MAB In rhis case also we obs rve that thcro is 
improvemont in the performance of MAB compared to DFC 

As another example we considered a telephone channel 
given in [33] In Table 8 3 we have given the equivalent 

Table 8 3 Channel sampled response coefficients 


Channel Symbol Channel par meters 

duration 
(in nano- 
seconds) 


GBSl 3 

GBS2 2 5 


d 


min 


2 0 
2 0 


&Do3 


2 


013 - 067 074 ^03 910 

01 044 - 094 031 j6i 321 

017 044 - 086 272 676 678 


1 719 


1 
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FIG 8 13 Effect of increased ISI on the performance 
of MLB 



FIG 8 14 Effect of increased ISI on the performance 
of MAB 
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discrete time response values for various data ra es Th^ 

performance curv s are shown in Figures 8 1 J 8 16 In 

this case however BOX does not seem to enjoy noticeable 
advantage over CSDr 

Summarizing w evaluated th performance or various date 
recovery schemes using simulation It may be noted that c rc 
must be exercised while making observations or -fhile drav;ing 
conclusions regarding a particular sch nc bas a on simulation 
results Thus with limited numb r of '^xampits and in the 
absence of any theoretical justification it is difficult to 
maK any definite conclusion regarding the upsriority of 
ono sc hem over the other However from our limited simula- 
tion eyporiments on typical channels it app ars that by 
choosing moderate block size and with incr ased data ra e 
over the chann 1 LB can be effectively implemented at a 
reasonable computational and storage conole co o red to 
MLC which requires large amount of storage as ID >> 5g 
Similarly we have obs rved that when the value of d^^^^ is 
close to 2 COB or SCB works w 11 compared to MLB with 
relatively small amount of SNR loss ^lAB also seems to be 
effective compared to DFC although it requires more storage 
Moreover it limits error propagation to a block length in 
the worst situation - a feature absent in the case DFC 
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CHAPTER 9 

CONCLUSIOjJS and suggestions top FUPT~£ft P£SEARCr' 

In this thesis we have investioated the problem of 
recovering data in block data transnii si on systems We have 
develoo d several data recovery schemes and con\ ared their 
performance with DR schemes available for continuous serial 
data transmission s stens The data recovery proolen has been 
viewed as a finite deconvolution probi m in th" oresence of 
noise Three deconvolution methods have bo n studied in 
detail They are maxinum likelihood decision feedbacl and 
least ouares deconvolution methods The DR schemes developed 
on tie basis of these deconvolution methods nay be vie/;ed as 
counterparts of the maximum likelihood decision feedback and 
linear DR schemes in the context of CSDT 

At this stage it may be appropriate to note the following 
difference between BDT and CSDT systems Due to practical 
consioeratlons in CSDT systems truncated number of ooserva- 
tions are used for making decision r garding a transmitted data 
symbol sithough in theory w'^ must use the entire observation 
values Thus the numb r of observations used for making deci- 
sion determines the p rformance of a given DR scheme In BDT 
we control the data rate and data transmission format so as to 
achieve bettor trade-off between error performance and computa- 
tional complexity 
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Sail nt features the study earned out in this thesis 
and sugges ions for further research ar gi ^on in th following 
para:jraphs 

The manmutn liJ^olihood recursiv d c nvolution al rithm 
dovolopcd in Chaptei 3 is simpl to understand compared to the 
convontiona Vitcrbi aljoiithm approach v/hich m-''cs use of 
Bellman s principle of optimality and state r p^cs'^n'i'ation The 
tlL-RDA developed u ing Mit en s 1 ir ia provi Ics nor insignt 
into the data recovery problem compar o to tY Vits,rbi algo- 
rithrr application The computational cornpl xity and storage 
requirctnonts of ML RDA grows lineerJy vith the block lengtn 
and exponentially with he channel nemory Simulation studio 
on some typicil channels using iL RD for BOX and CoDT s/stems 
show thnt ML-RDA for CoDT system requires more storage and 
computational complexity compared to ML-RDA for BDT systems in 
order to achieve same error performance 

VI have further shown that in the case of binary dat^ it 
15 possible to roduco both storage and computatior al require- 
ments of ML RDA by using results from the theory of Boolean 
and pseudo-Boolean functions Dcvcloom'^nt of similar methods 
for multil vel data using sonc of ne t hmau s given in [72] 
for dealing with functions of discr^ to variabi s i an 
interesting area for further resGa'>'ch 



199 


Ue have also shown that the method of minimizing pseudo 
Boolean functions provides a goo franie\;ori ■^'or developing 
ML“*decoding sch Ties for binar/ error correcting block codes 
Examples given in Ch pter 3 illustrate the usefuln ss of th 
method described /t however have not stucied this aspect 
in detail The technique d velooed in this thesis can be 
extended to nonbinary codes al o oetailed study of codes 
over other fields using sone of the r suits available in [72] 
IS expected to prove usefu in a better understanding of ML 
decoding of linear as well as nonlinear block coues 

The decision feedback scbenes developed m Chapter 4 are 
computationally more attractive in s tuations vhere ML-RDA 
becomes uneconomical Unlike the conventional methods of 
deriving decision feedback data recovery schemas w have moti- 
vated the idea of decision f edback via Gaussian elimination 
method He have shown that th moaifiod Austin approach can 
also be viewed as Gaussian eliminatior method with a nonlinear 
decision device 

The DF-DR schemes for BDT systems restrict error propaga- 
tion to atmost a block length whereas in the cas of DF-DP 
schemes for CSDT systeTs error propagation can extend to much 
longer durations However DR sch mes f r i^DT systems require 
more storage compared ro DR schemes for CSDT systems for 
achiev ng same probability of error performance 
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Th© DR scheme studied in Chapter 5 have the lea t 
computational and storage requixenents compaxed to t cse 
studied in Chapters 3 and 4 However thi i only at t e 
exoense of pTobabilicy of error performance Hov;ever simu 
lation studies snow that ir the case of a gooo oi 

channels DR schemes based on V Pirculant completions per orms 
well compared to DR schemes based on LS~deconvolution Je 
have shown that k Circulant completions of th channel convo 
lution matrix provides a more gen ral etting for studying 
deconvolution problems using di cr te Fourier transform a 
detailed study of optimum choice of x-Pirculant completions 
according to some performance criteria needs further investi- 
gation 

In Chapter 6 v/e have showed hat deconvolution using DFT 
and least squares deconvolution can be viewed as particular 
cases of square conpletions of the channel convolution atrix 

Detailed anal/ is of he Steepest d scent algorithm in 
Chapter 7 shows that in the case of som« examoles good estima- 
tes of the convergence parameter can be obtained using 1- 
Circulant completions This analysis clearly explains the 
observation made by others that DFT domain fixed tep steepest 
doscont algorithm converges faster han the sa pie domain 
cheines Moreover vv have shown that such cstimac s can be 
used in the sample domain i achiev govd convwroence 



201 


The simulation results given in Chapter 8 cov -"a aJ 
range of block lengths and typic 1 channel exa pi s It is 
interesting to note that the effoc of incr as'^d ISI among 
the symbols of a block duo to increased data rate ov r the 
channel on the perforrance is not signiiicant Simulation 
studies also indicate that vith appropriate ch icc of block 
lengths BDT provides better tr dc“Off b tv/een rror rforrrance 

and processing c rplexity corrpar d to th av il blc DR schemes 
for CSDT syste IS Howev r as imulation results arc al\Ja/s 
based on a few examples n definite claims can bo made regard- 
ing the superior! y of BDT ov r CSDT 

The maximum minimum distance and maximum dist nco channels 
obtain d in Chaoter 8 sho\^ th t seme of the good channels are 
partial response channels How ver in the absence of any clear 
definition of partial response channel [94] it is difficult to 
show the connection between paitial rcsoonse no MAD or MD 
channels This asp ct needs further investigation 

Another asoect of the data r covery problem in vhich we 
could not achieve much success is in obtaining go c bounds for 
the error p rfrrm nee of max mum likelihood ana d cision f d- 
back sch mes The difficulty soerjs to be du to the nonlinear 

noture of the DR schemes Ho/i/ever v/ still f el that it must; 
b possible to obtain useful bounds for orobability of error 
which in this case will be functions of block length and channoi. 
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meriory ihi aspect requir s further in /estigation Sone 
v\/ork in this direction has b en carried out bv Klein and 
rfolf [54] 

In his thesis we have not considered the problem of 
adapting the parameters of th data recovery schem s to the 
channel variations Depending on the nature of the channel 
variation the desion of th dat r covery schemes v;ill change 
The problem is interesting due to th presenc<= of noise and our 
limitation in recovering data \atnout errors Further investi- 
gation is needed to understand various aspects of this problem 
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APPO'DIX A 
BITTEN S LE lA 

In this appendix we state and orove Mitten lernma [^5] 

Mitten s Lernma Let X = (x) be an arbitrary set and let 

= (y^) 1 = 12 n be finite sequence o arbitrary 

sets whose definitions may depend on y £ X Let y^) 

1-12 n be a sequence of real /alued functions for 

which = rnin[gj^(x i e Yj^( x)] exists for i = 1 2 n 

and all xeX Let f(x) be an arbitrary function and let 

valued function for which g = min[g(Xj^ y^^ j 

X eX y^ £ Y^(x) i = 1 2 n] ists and h^i,x) = h[f(x) 

^ “K 

gj^(x) gj^(x)j exist for all <eX If 

h (x) < g(xj^ /^) for ver/ x e and y^cY^Cx) 

1=12 n then g = nan[ h ( x) j x e X] = h 

Proof The lemma can b proved b-^ the method of contradiction 
For this purpose assum that there exists x eX and y^eY^Cx ) 

1 = 12 n such that g(x y^j^ < h 

But from the definition of minimum h < h (x ) and 
h (x ) ^ g(x y„) by 'the assumed property of h (x) 

Therefore 

g(y y^) < h"" < 1 ^ ( X ) < a( X /^) 


which IS a contradiction 
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APP r DIX d 
k CIRCUL n UTRICt 

The puroose of this apoen ix i to list a ie\/ properties 
of k-Circulani matrices [8i] [82J 

The k“Circulant matrices con adored in oir study have the 
following structure 



where |kj =1 When k = 1 is a Circulant matrix k = ~1 
gives skew Circulant matrix Skew Circulants ar also known as 

negacyclic matrices [82] 

It IS convenient to stuoy k-Circulant jitn xhe help of 
the simple k-Circulan mtrix 




205 


\ matrix A is said to be t' Circulant iff 
A<ik = n^A 

in terns of ilk expressed as 

= <=oIn + '=l'1k + ^ 2^1 * (3 1) 

S nee every k Circulant latrix commutes vath ix is suffi- 
cient to know thte eigenvalu s and eig nvectors of in order 
to characterise and analys Circulants 

Ihe eigenvalu s of are the nth root of k for the 
characteristic equation of T)j^ rs given b/ 

- k = O 

Lot p be. an nth root of k Th n pw^ i = O 1 n-l 

Jhere a) = represents n roots of X’^-k = 0 

We now show that th v ctor 

X = (1 x“^ x”^ j^-(n-l)) J,g JJ 3^5 

root of k IS a eigenvector of 

A simple calculation shows that 
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Thus n roots of k generate n eigenvectors of hj Let be a 
matrix with the n eigenv ctors of as columns It has the 
following form 


fn 


-1 

(pw)'^ 


-2 

(pio) ^ 

(po." ^ 

-(n-l) 




iu 2 ) 


Note that ^ IS just a normalization factor used for making 


F“^r = T 


Using B 2 it can b shown that 

"k 


(B 3) 


where is a diagonal matrix with pw^ i = 0 1 n-l as 

d agonal elements 

Wh n k = 1 Bje ~ P matrix is obtained In 

Virtue of this wo shall refer to as iC-DFT m trix In t rms 

of F we can write FT"^ a 


F 


-1 

k 


“1 “1 

:= D -^F 


(B 4) 


Where D is a diagonal matrix with i = 0 1 n-1 as 

diagonal entries Using (B 4) in (B 3) v obtain 
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F U \ 5) 

I f 0^ IS a Circulant ma rix we kno ; hat 

r {b 6) 

where A^ is a diagonal natrix with eigcnv lu s of Cj^ as 
diagonal entries 

Comparing (B 6) anc. (d 5) we see that j D”^ repre- 
sents a Circulant matrix 

Post and pe multiplying 8 1 oy anu re pectiv ly 

and using (B 3) \e obtain 


fk 


Col + /'i. + 4 AJ + 


C A 
n-1 ^ k 


(B 7) 


From (B 7) we see that if i = 0 1 

eigenvalues of Cj^ 

n-1 . ^ 

\ ~ L C (pw^)^ 

1 j=0 J 


n 1 tare the 


(B 8) 


(B 8) can also be rewritten as 


K 

1 


n— 1 , ^ 

Z, (C.p-^) 

3=0 


(B 9) 


(B 9) exhibits an interesting aspect eigenvalues of Cj^ can 
determined by finding the eigenvalues of a Circulant matrix 
having firs column 

(C„ C^p CjP^ 


(B 10) 
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This can also be seen directly u mg (B 7) Usina (rf 4) in 
(B 7) we get 

FDC,^D"^r“^ =A = diagCA^Xj^ ( B 11) 

Therefore ^ is a Circulant matrix B/ little calculation 

we can see that the first column of this n trix is given by 
(B 10) 

Finally consider inverse of a 1-Circulant riting (B 3) 
in terms of whenever exists /e get 

-1 „ „ 1 . -1 
*” ^ k k 

which shows that inverse of a k Circulant whenever it exists 
IS also a k~Circulant 
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